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ABSTRACT 

This paper reports a portion of a research effort to 
develop a program which will simulate the language learning 
behavior of humans* Here presented is a heuristic parsing 
procedure which accepts natural language sentences and produces 
for each a form of analysis called a "labeled dependency tree". 

The formal grammar on which the procedure is based differs from 
the "phrase structure" formalism of Chomsky (1957)* and the 
analysis procedure attempts to discover the single most probable 
analysis rather than all analyses of ambiguous sentences. 

Included are discussions of the syntax-meaning distinction, 
the special problems of simulation, and the need to handle a 
general class of inputs, and the need for analysis procedures 
which are to be self- organ! zing* The paper describes a computer 
program for analysis of sentences and reports an experiment with the 
program* 
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The burgeoning Intoroot In computer prooooolng of natural 
languages hae resulted In a large matter of programs and proposed 
programs for producing parses of eentencee (Bobrow, 19^3) • It is nov? 
dear that there is no single procedure best suited for all purposes, 
but rather the parsing procedure for a given task must depend upon the 
larger goals envisioned by the system designers. Thus a procedure 
which is appropriate for a natural language translation program will 
probably be unnecessarily elaborate for use In p-ocessing unambiguous 
computer languages as required In syntax directed compilers of the 
sort proposed by Irons ( 1961 ). **•<>» procedures based upon a "predic- 

tive analysis" scheme [Rhoades (1959). Lindsay (1961). Oettinger (IS61): 
are perhaps better suited for simulation of human cognitive processes 
than those based on phrase structure analysis [e.g., Pendergraxt ( -SSx, . . 

Research on automatic syntactic analysis has been greatxy 
influenced by the work of Chomsky (1957,1959,1963) on formal descrip- 
tive linguistics. Although the program laid down by Chomsky is well- 
defined and intuitively appealing, the translation of Chomsky's wor* 

Into a workable machine system encounters several difficulties. The 
most obvious difficulty is the discovery of the grammar for the natural 
language which the machine Is to understand. One solution to this 
problem is to develop a learning procedure which will discover an appro- 
priate grammar, or. equally as good, discover a parsing procedure which 
is appropriate to the language. The only extensive effort along these 

lines is the work of Knowlton ( 1962 ). 

This paper reconsiders the problem of syntactic analysis and 

describes an approach which attempts to circumvent previously discovered 
difficulties. In particular, the procedure is directed toward developing! 
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a m a c hine which learns to parse sentences In such a way that the 
resulting parse Is usable for other processing. 

CHOMSKY'S FORMALISM AND THE PROBLEMS IT RAISES 

Consider a finite set* U» of symbols and the infinite ■ 

S, of all strings formed by concatenating a finite number of In- 
stances of symbols from U. A language* L, is a subset of S, and - 
grammar, G, of L is a procedure which could produce all members o. 

L but no strings which are not members of L. A parsing procedure 
Is a program which will discover, for some strings of S if the string 
is in L, and may describe one or more sequences of steps such that if 
the sequence is performed by G the given string will be produced. 

The above outline is the now familiar definition of syntax 
offered by Chomsky (1957). Also familiar are various metalanguages 
su gge sted by Chomsky and others for the representation of grammars. 
Perhaps the most frequently employed metalanguages are of the "phrase 
structure" type. These are described in detail elsewhere [see Cnom-.^y 

(1959)* Yhgve (1951)* and Backus (1959)). 

The first difficulty encountered with Chomsky’s analysis 

involves the phrase structure formalism. Chomsky states that phrase 
structure grammars are "quite neutral as between speaker and he 
(1961, page 7). Although it is true that, given a phrase structure 
grammar, one can develop a parsing procedure which will produce a*, 
parses of any sentences of the language for the grammar, it does not 
follow that the parsing procedure is a convenient, efficient, or 
natural one. Indeed it may not be. Phrase structure grammar.-, 
are a much more convenient formalism for defining a mechanism 
for producing sentences. For the purposes of analysis, predictive 
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techniques seem to be more efficient, and as has been argued elsewhere, 
they are more appropriate If one Is Interested In simulating human 
language behavior (Lindsay (1963* Hockett (1961)). 

A second difficulty raised by Chomsky's definition of the 
problem Involves the discovery of a grammar for a language. In brief, 
no answers have been supplied to this problem. Current practice 
relegates the task of grammar discovery to a linguist or other person 
familiar with the language in question and the metalanguage of the 
grammar. Chomsky (1957) is pessimistic on this issue. 

A third difficulty Is that of defining the language to be 
studied. With formal languages this is usually accomplished by 
specifying the grammar, which thus defines the language. Chomsky 
proposes a similar procedure for natural languages: define a grammar 

which admits all sentences which are obviously in the language (e.g., 

"I am a man") and rejects all sentences which are obviously not in 
the language (e.g., "of sklggle the the, fard"); then use the grammar 
to decide on doubtful cases (e.g., "I is feelln' poorly"). 

It seems, however, that this suggestion, while making the 
scheme workable, does not really advance our knowledge of language. 
Intuitively, one would like to specify the language and then find a 
grammar for it. Unfortunately, deciding what is and what is not, for 
example, English, is an elusive project. Certainly, English is not a 
finite collection of utterences, and hence cannot be defined by ref- 
erence to a corpus; we must include not only what has been said in 
English, but what might be said as well. But we must not include 
everything which might be said, because some of it will be said in 
French. And we cannot include everything which might be said by 
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English-speaking people, because some of them speak Russian as 



well. 

Based on this discussion, Chomsky's position becomes 
more attractive. And yet if we accept this egress in order to 
get on with the business of developing automatic procedures for 
handling a useful range of natural language inputs, we may cut 
ourselves off from all hope of capturing the human's ability 
to process language. 

This ability is noteworthy for its flexibility. For 
example, if a typographical error is encountered, a human does 
not indicate an error halt; in fact, it is almost always true tnat 
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any two words oan be transposed in a passage without dicrup^in 
processing, and even in cases where the sense of the passage 
changed though not detected processing does not fail. If a 
strange dialect or idiom is encountered, or a novel turn of phras; 
is presented, most intelligent humans are able to make some sense 



of it. Indeed Chomsky's well worn example of a grammatical but 
meaningless sentence might pass for profound poetry in some circles 

"colorless green ideas sleep furiously". * . 

A system based on a fixed grammar and parsing procedure 

which must succeed before any further processing can begin will 
not be able to handle any of the above situations without oexng 

so extremely complicated as to be unusable. 

Fourthly, since phrase structure grammars are so non- 
committal on the question of analysis, the parsing procedure is 
not really defined by the grammar. If one is interested in 
obtaining all of the legitimate parses of an arbitrary input. 
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there are well-defined procedure! f roil which one may sake a 

* ■ ■ * . ■ ■ ^ . 

•eleotion solely on the basis of fffloleno^ Howev^r it must 
bt mubint that syntaotls iuItim in not tbs dsslvsd and 
result of language prooeselng. Baually, aceningly ayntaotloally 

arabiguous aantaneea are not eablguoua at all to the hearer. In 

*■ 1 ( , ■ 

faot lntroapeotlon will usually reveal that tha hearer la 
inawava of interpretations other than tho single ana ho "has in 
*ln4". further, if the hearer, ahllo reading a scntcooe suddenly 



finds that things "do not fit" syntaotloally, ho mat begin again 
and ssaroh for the point of error; ho dosa not simultaneously ooaputo 
all possible parses. The minor problems of ambiguity thus for 
encountered with eyeteme based on a rigid grammsrahd aji. exhaustive 
parsing procedure are illustrated by . Oettinger and Kune (1963). 
their grower and parsing prooedure produoss three parses of the 
sentence "They are flying planes”. fhs least Ohvlbua la that in 



trtiloh "planea" la a vert. Our point la that this analysis:. Is 

eo obsoure that most people fall to see it even after it* ie 

• * , ■ ^ 1 . 

pointed out to them; dearly they did not produce it by themselves 

• ' i , * * 

m any oonsdous , usable forme To handle this problem# a parsing 

■ ■ ^ • t 1 . ■ ■ 

prooedure must have the property that it produces parses one at 
a time# the most probable one first and the eorreot one seldom • 
later than seoond; and. that the semantic rejection of false 

p a t h s proceeds step-by-step (itord-by-word) with the syntactic 

1 *” * N ' • * t . . 

analysis.'' ■ * \ 






finally# Chomsky's program does not yield any insight 



o^ ^e Important question of language learning# 
thui far proposed are overly rigid in the eenee 
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are either legitimate or not legitimate; there Is no provision 
made for assigning a probability to a construction (although It 
is readily possible to assign probabilities to members of a set 
of possible parses, each of which is legitimate). On the one 
hawH this means that if one wishes to have a non-restrictive 
( overgeneral ) grammar, it is necessary to specify more details 
of the parsing procedure lest it give equal credence to the unlikely 
parses and hence take an excessive amount of time to perform ar. 
exhau stive analysis. On the other hand it means that the informatio; 
about the language is not divided by the grammar into portions which 
can be learned in a manner analogous to human learning: for 

example, the program either understands all infinitive construe cio.-vs 
or none; it either understands the passive transformation or it 
does not. Although it is a gross over simplification to assume, 
as is the fashion in most current psychological learning theories, 
that learning occurs in tiny steps through some form of reinforce- 
ment, it is equally unlikely that the child learns powerful 
generalizations in a single learning step. What is lea me., on a 
single trial lies somewhere in between, and neither phrase 
structure grammars nor transformational grammars appear to provide 

the right sized pieces for learning. 

One approach to the problem of language (or a* ±ea.oo 
grammar) learning is to simplify the grammar and complicate the 
parsing procedure. There are two avenues suggested by phrase 
structure formalisms. On the one hand* one could construct 
an undergeneral grammar which could produce no sentences not in 



the language but could not produce all sentences in the language. 
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The learning program would then add rules to the grammar as they 
are needed. On the other hand, one could begin with an over- 
general grammar which could produce all sentences in the language 
and many nonsentences. The learning program would then modify 
itself so as to discard analyses which were acceptable to the 
grammar but improbable for the language. 

One difficulty with the first procedure resides in the 
fact mentioned above, that the pieces to be added are not the 
psychologically correct size. A second difficulty involves the 
manner in which the machine would be told to add a new rule. 

One possibility would be to present the program with a sentence 
involving a new structure and then present the analysis. It 
would then be a simple matter for the program to detect the new 
rule and add it to its grammar. This procedure is unsatisfactory 
because it is unrealistic. Children certainly are not taught 
in this manner and in fact could not be so taught until they 
possess a great deal of knowledge about language and about 
language analysis— something which most people never acquire. 
Furthermore, the burden on the teacher would be enormous. A 
more natural learning situation is one in which the teacher 
merely supplies more gross information, such as whether the 
child* s reaction to (analysis of) the sentence is appropriate -• 
a whole, without detailed feedback of the source of difficulty. 

It is desirable that a learning program be instructed in a simi.vr 
manner. 

The second procedure, employing an overgeneral grammar 
and a complex analysis procedure, appears to be more fruitful. 

ERIC 
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One such attempt has been undertaken by Knowlton ( 1962 )# The 
learning demonstrated with Knowlton* s program was marked in the 
very early stages (the first 30 sentences), but quickly reached 
a fairly low asymptote (about 50# correct analyses). A sufficient 
number of variations in the program, however, remain to be tested, 
and hence the technique cannot be discarded. Perhaps, however, 
Knowlton * s procedure of basing the decisions concerning the 
analysis path to follow on simple statistics collected from 

previous analysis is oversimplified. 

The learning procedure to be employed in the present 

work is based on the second approach, although it differs from 
Knowlton*s work in major respects. The details of the learning 
scheme will not be given in this paper. It will be apparent, 
however, that the linguistic description presented was developed 
with the learning problem in mind. 

THE DISTINCTION BETWEEN SYNTAX AND MEANING 

In light of the above, it would seem essential that, in 
order to decide on a syntactic processor, we have a formal 
definition of the subsequent processing. The general consensus 
of experts in the field is that the syntactic analysis procedure 
is fairly well understood, but that the problem of meaning has not 

i 

f been adequately formulated. And yet some would argue that, having 

r shown the distinction between the three parses of "They are 

f flying planes", a program has demonstrated some knowledge of 

meaning. Where does syntax end and meaningful interpretation 

begin? 
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Most persons admit to an intuitively felt distinction 
between the syntax and the semantics (denotative aspects of 
meaning) of a language. In formal logic, this distinction is 
clearly drawn, but in the study of natural language it is not. 

Thus one could argue that there exist meaningless but grammatical 
sentences (such as Chomsky's examples "Colorless green ideas 
sleep furiously") and that it is appropriate to capture this 
distinction through formal definition. 

Chomsky has pointed out that his formal definition of 
grammar does not satisfy our intuitive notions of "syntax". For 
example, a listing of the sentences of L, if L is finite, is a 
satisfactory grammar by the definition. However, such a grammar 
is not useful because it is not "revealing". 

Although "revealing" is not formally defined, Chomsky 
offers some examples. In the first place, he argues that a grammar 
should yield multiple methods of generating ambiguous sentences, 
as in the example of the flying planes and the planes which are 
being flown. Going even further, he argues for transformational 
grammars on the ground that they more readily reveal the common 
content of the two sentences "The man hits the ball" and "The 
ball was not hit by the man", even though the sentences are 
otherwise unsimilar. 

The position adopted here is that grammars which go 
beyond a simple classification procedure (which decides whether 
a given string is in the language) are partial descriptions of 
meaning by virtue of the fact that they reveal structural 
relationships. While it is true that a formal definition of 

o 
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a language through a phrase structure syntax can be called a 
grammar, thus making a distinction between syntax and meaning, 
the distinction is arbitrary and could be drawn elsewhere by 
extending or restricting the set of grammar rules. Should "the 
man is the house with glasses" be parsed in more than one way? 

The decision is arbitrary. 

It is possible to restrict the descriptive power of 
syntax to a procedure for classifying sentences without revealing 
structure by a technique other than a simple enumeration of 
sentences. This could be accomplished, for ‘example, by a collection 
of rules which specify the legitimate local contexts of words 
of the language. Thus in a compiler, a few simple rules which 
admit the sequences "((" and "(a" but reject 'W and "+)" 
would constitute a grammar which defines the tactics of the 
language. The interpretation of an input such as "X = A*(B+C)" 
such that the essential structural relations involved are revealed 
would lie outside the domain of tactics, and outside the domain 
of syntactics if the grammar were so defined. 

If one allows syntax to go beyond tactics, the point at 
which semantics enters has no intuitive currency. This is no* oo 
say that any other distinction is of no value; it is merely 
arbitrary. It is certainly feasible to define the grammar of a 
language to be a procedure which will generate all meaningful 
sentences of the language and no others (defining the meanings u^. 
sentences is no more difficult a problem than defining the 
language). Vfhether it is possible to write such grammars wi ohu.n 
any of the metalanguages thus far proposed is not known, buo it 
seems unlikely. 
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REQUIREMENTS FOR A LANGUAGE PROCESSOR 

Thompson (1963) has presented a cogent discussion of the 
concept of the structural interrelations in language. The view 
presented there, and adopted here, is that language serves to 
define the manner in which the (semantic) structures of the 
constituent referents are to be combined into a larger structure. 

One sense of the word "dog” denotes to an adult English 
speaking person, a complexly structured entity, with hair, eyes, 
legs, teeth, bones, atoms, saliva, calcium, .fleas, and other 
substructures interconnected in a complex manner. "Man" 
likewise denotes another complexly structured entity. The 
sentence "The dog bit the man on the leg" serves to interrelate 
the structures denoted by "man", "bit", "dog", and "leg" in 
such a way as to represent the event. In particular, those aspects 
of structure, which are of no importance such as the hair of the 
dog and the man»s freckles, take no part in the operation. 

This view of the function of language is in the tradition 
of presentational psychology and its descendant. Gestalt psychology. 
The process so described also lies at the heart of the problem 
solving theory of Duncker (1935)* an< ^ importance in the 

development of inferential memories, as discussed by Lindsay (196M* 

The theory of data structures is not sufficiently 
developed to enable us to program machines to build sophisticated 
representations of the full range of topics which may be discussed 
by a natural language. It is, however, possible to explore 
partially the manner in which such representations might be 
employed in a language processor. Thus it is possible to code 
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interpretations of linguistic inputs in such a manner as to make 
use of the power of list structures while not discarding information 
which cannot be conveniently coded with these techniques. The 
residual information which cannot be placed implicitly in the 
associative structure may be carried explicitly by encoding with 
arbitrary symbols. (See Raphael (1964) for a discussion of this 

issue. ) 

Another desirable feature of a language processor is 
that it must not be halted by things it cannot understand, such 
as "#*#5/. ..;+«9)"; that it must extract whatever information 
is available from an input, such as the family relations described 
in "Fred*s brother John fidge web in zot thethe and Ed married 
Fred whose Clyde is famy"; that it must develop reasonable 
interpretations of such inputs as "Colorless green ideas sleep 
furiously"; that it must develop reasonable hypotheses as to the 
reference of new words as in "The stick is plard ; and that it 
must be able to handle typographical errors and other word games 
in a reasonable manner, as in "The the saw tail dog man wag its". 

Finally, it is perhaps true that attempts at developing 
learning programs have been overly optimistic in supposing that 
machines can learn complex things by random exposure to a 
sufficient amount of information. Children, or adults, seldom 
do. The process of teaching is an elaborate procedure whicn 
proceeds from the simple to the complex with plenty of practice along 
the way. Learning a language is one of the most complex tasks a 
computer will ever do, and it is not unreasonable to suppose 
that the education process will require an extensive and complex 

ERjt 
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exposure. However, the machine should be resistant to bad 
teaching, Just as children are, so that poor instruction over 

short periods of time can be overcome without permanent impairment. 

. 

In summary, we require as a minimum the following: 

1. A language processor should build list structures 
which preserve and encode all the information necessary for con- 
struction of the interpretation when we discover how to represent 
it. 

2. A language processor should accept any input consisting 
of strings of symbols from the alphabet of the language and 

should process the input, interpreting all of it or as much of it 
as an intelligent adult could interpret. 

3. A language processor should be able to learn a 
language through a judicious training sequence no more extensive 
(and probably no less extensive) than that employed in teaching 
a child to speak and read. 

JIGSAW 

A proposed computer program called JIGSAW has been 
designed to meet the criteria outlined in the previous sections. 

It will described here, and a later section will describe in detail 
the first version of this program, JIGSAW-1, which is operational. 
JIGSAW-1 does not embody all of the features proposed for the 
JIGSAW system. 

The basic organization of JIGSAW [see Figure 1] err, bodies 
a procedure which is basic to heuristic programming: the system 

is divided into two sections, one which proposes a line of attack, 
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and a second which attempts to carr out the proposal. In the 
context of parsing programs, this principle has, according to Hays 
(1961, page 368) "been invented, lost, and reinvented many times". 

In the program described by Hays, the procedure divides syntactic 
rules Into "word-order rules" to propose constructions and 
"agreement rules" to test the proposed construction. JIGSAW 
employs a similar division, the details of which will now be 
described. 

Strings formed by the concatenation of symbols (words) 
are input and an interpretation of the string is constructed. 

The interpretation is a structural representation of the relation- 
ships among the words, and is expressed as a graph of some or all 
of the words. A dictionary specifies the possible structural 
interconnections. A syntax directory is used to retrieve syntax 
routines which select from the set of possible interconnections 
those which are to be attempted in the given linguistic context. 

If a proposed connection is possible according to the dictionary, 
it is effected; if it is not possible, it is abandoned. Processing 
proceeds in a single left-to-right scan of the input string and 
produces a single result; however, the result may consist of 
several disjointed structures. If the result is rejected oy 
an external agency called the teacher , JIGSAW is able to cons true o 
a second result. If JIGSAW'S cognitive limits are exceeded 
during the processing of an input, it is possible to force the 
program to combine separate pieces of its structure. This may be 
done by (a) forcing a structural connection which is proposed by 
a syntax routine even though it is not acceptable to the dictionary. 
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Figure 1. Main Flow of JIGSAW 
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or (b) employing a structural oonneotlon which Is acceptable 

« 

to the dictionary even though it has not been proposed by any 
syntax routine. If any structures so formed are acceptable to 
the teacher, JIGSAW may learn by modifying Its dictionary or syntax 
directory so that the structure forced is now acceptable, and/or 
by changing a syntax routine so that the structure is in the 
future proposed in similar linguistic contexts . 

The behavior of JIGSAW may be described for purposes 
of illustration by the following simple example. Assume that the 
dictionary allows structural connections of type PI and F2 to exist from 
"red 11 ' to "rose", and structural connections of type FI and F3 to exint 
from "rose" to "red". Assume also that when "red" is encountered, 
a syntax routine retrieved from the syntax directory proposes a 
structural connection of type FI, and sets up an expectation 
for something which will fulfill this proposal. When "rose" is 
next encountered, an interrogation of the dictionary reveals 
that it is possible to form the FI connection from "red" to "rose", 
so this is done. If the opposite sequence "rose red" had been 
encountered, a similar procedure would have produced the similar 
but reversed structure, with "red" acting as a noun. If the 
teacher indicates that this is acceptable, no change is made in 
the dictionary or the syntax tree. 

If a new input string begins with "red" and is followed 
by "clyde", the proposed connection is rejected by the dictionary 
which has no information about "clyde"; the two words are saved 
as separate structures. If, however, saving the two words exceeds 
the cognitive limits, a connection of type FI is forced, since that 




Is the only proposed connection* If the teaoher accepts the 
resulting structure* the dictionary is modified to make this 
connection a possibility in the future. If now the next input 
string begins with "famy", about which no information exists 
in the dictionary and for which no syntax routine is recovered 
from the syntax directory "famy" is stored. Assume the next 
word to be "rose". No connection is proposed* so the second word 
is saved. If this aotlon exceeds the cognitive limits* the 
dictionary is searched for a possible connection; an FI con- 
nection from "famy" to "rose" is established. If this is 
acceptable to the teacher* the syntax dlveotory is modified to Include 
a routine for "famy" which will propose an FI connection in 
the linguistic context of "famy", A fourth string, "famy 
Clyde" will now be processed to produce a structure relating 
"famy" to "Clyde" with an FI connection, even though JIGSAW 
originally had no information about either word. 

Brief descriptions of each of the features of JIGSAW 
will now be given to indicate the range of possibilities 
envisioned. In the next section, a particular interpretation for 
each feature will be described in the manner in which it has 
been implemented in an operational version called JIGSAW-1. 

The interpretation . The result of processing a string 
should be a representation of the "meaning" of the string. 
Unfortunately, we do not know how to represent meanings* although 
it is possible to specify some criteria for the representation. 

This has been done by Lindsay (1961), where it was pointed out that it 
is necessary for the representation to model the subject under 
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discussion in such a way that the essential relations among 
the concepts disoussed are reflected by the representation. 

This would allow inferences to be made beyond the information 
explicitly contained in the input, and would also allow the machine 
to perform "gedanken experiments" to test its understanding of 
the subject. Lindsay (1961) has programmed a linguistic machine 
to construct such representations for a very limited class of 
subject matter; Raphael (1964) has explored a more general but 
less poweiful representation in the SIR program, but avoided the 
problem of translating from natural language to the representation. 

Simon (1962) in programming the heuristic compiler has 
explored the problem of translating from natural language to a 
representation in the form of description lists, which provide 
a representational language of sufficient power to handle certain 
expressions which might be encountered in an imperative language 
of the kind which might be employed as a programming language. 
Essentially the same ideas have been extended and elaborated 
by Thompson (1963). Thompson argues that, since we do not have 
programming languages or theoretical expertise to describe and deal 
with arbitrary data structures, it would be fruitful to attack 
the problem of translating from natural language into representations 
using the data structures for which current technique*. are 
available. Although this limits the subject matter which can be 
handled, the range is still quite broad in relation to the present 
8 tate- of- the. -art • Thus, in his DEACON, system, Thompson attempts 
to translate from natural language into data structures which can 
be represented with list structures, description lists, arrays, and 
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numbers , slnee techniques exist for dealing with these structures# 

It is probably true that these structures are not powerful enough to 
represent systems which change with time in a continuous fashion , 
nor to deal with declarative sentences and the consequent inferences 
which they entail. Nonetheless, question-answering systems of 
significant versatility can be defined with these techniques. Thus 
in response to the question ”What men in battalion 10 have served 
for more than 20 years without an accident?”, DEACON might construct 
a list of men satisfying the requirements. This would be done 
by consulting a data store which represents ‘men, battalions, years 
of service, and accident records with list structures. The most 
important feature of DEACON is its ability to retrieve the requested 
information from any of a variety of explicit data representations; 
that is, the data may be organized as a list of men with associated 
accident records, service records, and battalion assignments, or as 
a list of battalions with associated personal files, or any of 
several other representations. The basis of DEACON is a set of 
rules which prescribe transformations from linguistic inputs to 
routines which modify data structures composed of lists, etc. 

JIGSAW envisions using structures more general than list 
structures. Although no language exists for defining or processing 
these structures certain design specifications have been outlined 
and will be described in a later paper [cf. Lindsay, Dauwalder, 
Pratt, k Shavor (1964)]. Data structures allowable in this system 
nill be (a) arrays and (b) any structure which is isomorphic 
to a colored line graph composed of nodes connected by labeled 
(colored) lines. Within this framework, limitations may be imposed 
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toy any particular version of JIGSAW# Such limitations serve as 
a useful heuristio device to check the legality of proposed partial 
structures. In JIGSAW-1 (see toe low) structures are limited more 

severely# 

Although it is nojb clear that colored graphs will allow 
the automatic inference properties discussed above, such graphs at 
least allow the preservation of the necessary information. Thus we 
might wish to represent the statement that event Z follows event Y. 
Although list structures do not permit this in a ’’natural” way* 
a special symtool denoting ’’follows in time** may toe used as an 
attrltoute on the description list of Y and be given the value Z. 
JIGSAW at present merely aims to construct such information 
preserving representations and does not attack the more difficult 
problem of constructing good representations. Clearly this limited 
goal can largely be achieved within the confines of list processing. 

The dictionary . In order to allow the overgeneral 
linguistic description which is necessary to handle an almost 
unrestricted class of inputs, the possible structural connections 
are stored with few references to macroscopic structural features. 
Thus, most structural information is stored on a word- pair basis; 
the possible ways in which two words may toe related do not depend 
upon the other connections entered into toy the words. For example, 
the dictionary might indicate that a connection is possible between 
’’tall” and ”man” without reference to any other aspects of the 
phrase in which ’’man” occurs. This would make possible a sentence 
such as ”the short, tall man”. On the other hand, the facility 
for recording phrase dependent structural rules is available when 
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needed. Thus It would be possible to allow a connection between 
"even" and "number" while disallowing a connection between "even" 
and "prime number". 

The Information contained In the dictionary Is of 

Importance not only for the analysis process , but for learning 

as well. It Is desirable to have available a test of consistency 

which could be employed to check new dictionary entries suggested 

by a learning procedure. If the suggested Information Is 

Inconsistent with other information in the dictionary. It would 

* 

be rejected. The work of Sommers (1961) Suggests a possible test 

* 

of consistency. Sommers defines a predicate with the Inter- 
pretation that Q •«- P if of what Is P, It can sensibly be said that 
It Is Q. Under certain assumptions, he is able to show that 
meaning classes may be arranged Into a tree. If Sommers' 
analysis Is accepted, a suggested sense relation could be tested 
for consistency with the requirement that the "semantic tree" 
be maintained. 

The syntax directory and syntax routines . A scheme for 
generating proposed connections Is needed. A syntax routine Is 
merely a program which assigns to a partial Interpretation a 
subset of the possible further connections Into which the structure 
may enter. The syntax directory is the store for syntax routines 
together with a procedure for retrieving them as a function of 
the linguistic context In which the partial Interpretation Is 
Imbedded. Similarity of linguistic contexts Is defined by the 
retrieval rules. Thus to select a syntax routine, certain questions 
about the Input are asked [e.g. "Is a noun phrase present?", "Is 
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the word "to" present?" "Is there any punctuation? ", "How 
oomplex is the structure so far?"). The answers to these 
questions determine which syntax routine will be selected. 

Certain features of a linguistic utterance denote the 
concepts being discussed and other features specify how the structures 
associated with these concepts are to be combined. Thus in the 
phrase "red rose"/ the concepts discussed are redness and roses 
and the relation connecting the concept is that (Jthe color of 
the rose is red". The connection is determined by the cue of 

a 

word order . 

Typically/ syntactic analysis attempts to interrelate 
all the words in a sentence on the basis of positional and 
punctuation cues. Thompson (1963) bas made the important observation 
that the usual dichotomy which places words in one category and 
positional cues and punctuation in another category/ is misleading. 

A more revealing dichotomy is between referent words, which denote 
concepts with structure, and function words , punctuation, and 
positional cues, which give information as to how the structures 
of the concepts denoted are to be combined. The identification 
of function words must, of’icourse, be formally specified by a 
linguistic description. However, the class would include most 
conjunctions , prepositions, articles, and logical connectives. 

In JIGSAW, the distinction between referent words and 
function words is sharply drawn but not easy to identify. Any 
word about which structural connection information is given in 
the dictionary is a referent word* any word whose presence or 
position is used as the basis of a retrieval function of the 



syntax directory is a function word. However, it is possible that 
the same grapheme may act as either a referent word or as a 
function word in the same or different linguistic contents. 

There is not a simple way to decide which role a given word plays 
in a given context without a detailed examination of the dictionary, 
the syntax directory, and the analysis procedure. It is important, 
however, to note that the interpretation of a string may not 
explicitly contain all of the words from the string; the 
information conveyed by some words may be translated into structual 
features of the representation, in the same manner as is done with 
positional cues. 

The teacher . The acceptability of an interpretation is 
decided by an agent external to JIGSAW. In actuality, the decision 
is made by a human who examines the program* s performance. The 
teacher, however, simply approves or disapproves, and is not 
able to point out the sources of difficulty. This strategy assures 
that the basis of JISGAW»s learning resides within its linguistic 
abilities. The programmer may teach JIGSAW a specific piece of 
information only through an appropriate selection of linguistic 

examples. 

The learning of language is accomplished by comparing 
linguistic examples with reality. In human behavior this may be 
accomplished by simply receiving approval or disapproval for a 
response to a sentence supplied by a teacher. However, it may also 
be accomplished by producing linguistic behavior which is Judged by 
asking specific questions of the teacher, or by asking questions 
of the environment in other ways, such as by performing experiments 
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(e.g. , touching a stove after the teaoher has said "then stove Is 
hot" comprises an experiment which provides Information about the 
correspondence of language and reality). JIGSAW'S limited ability 
to interact with the environment will prove to be a real limitation 
upon its learning ability. Nonetheless, the limited information 
obtainable from the teacher should be sufficient for some interesting 
learning, if the program is able to use it properly. 

Cognitive limits . Any sort of condition is permissible 
as a cognitive limit. The effect of exceeding a limit is to force 
JIGSAW Into a second, more desparate mode of behavior which attempts 
to make structural decisions normally put off until more information 
Is available. A variety of conditions may act as limits. For 
example, exceeding a limit on processing time or upon the amount 
of memory used for a given analysis, or any arbitrary limit 
imposed at random or regular intervals. After each word is processed 
JIGSAW employs a test which determines whether any limit has been 
exceeded. 



JIGSAW-1 

A program, coded in IPL-V [see Newell, et al . (1964)], has 
been written to test the feasibility of the JIGSAW approach. This 
program does not contain the full flexibility discussed above, but 
provision has been made for adding all of the described features. 

A detailed documentation of JIGSAW-1, including a listing of the 
program, is available in a separate paper [see Lindsay (1964}] . 

For JIGSAW-1, the interpretation is a labeled dependency 
tree* the dictionary is a simple table composed of IPL description 






lists* the syntax directory is a tree patterned along the lines of 
EPAM as described by Feigenbaum (1959)# th® cognitive limits take 
the form of a parameter controlled limit on the number of separate 
structures which may be held in memory, and the learning program 
is non-existent* 

Labeled dependency trees * A syntactic analysis closely 

related to immediate constituent analysis is dependency; analysis, 

first proposed by Hays and Ziehe (1959). This formalism displays 

structural relations among the words of a sentence by means of a 

tree which has words at the nodes and directed line segments 

connecting the words. [See Figure 2] The word at the tail end 

of the arrow is said to "depend” upon the word at the head of the 

arrow. The relation of dependency may intuitively be thought of as 

follows: removal of the governing word would make the dependent 

words meaningless, while the dependent words may be removed or 
* 

substituted for without destroying the sense of the sentence. 
Modifiers generally depend upon that which is modified; subjects 
depend on verbs; objects depend on their prepositions; etc. 

Formally, the dependency relations are defined by a grammar, but 
they are meant to reflect the structures of the language, as are 
phrase structure rules. 

A labeled dependency tree is a dependency tree in which 
the connecting lines bear labels which reflect the sense of the 
connection. Again, the placement of these labels is formally defined 
by the grammar, but the intention is to reflect the sort of 
structural interconnection between words which the sentence is 
meant to convey. Thus "green" might depend on "tree" in the same 
sense (via the same label) as "white" depends on "snow", but in a 
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Figure 2» A Labeled Dependency Tree 
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different sense thdn "green" depends on "recruit", even though 
in all cases the dependency refleots modification in the usual 
syntactic sense* In most instances, "the" would be dependent 
upon a noun via the same label; but in some instances, such as 
in "the more the merrier", the label might differ* 

The requirement that the interpretation be a tree is a 
marked restriction* It is, however, a useful restriction, since 
it serves to reduce the number of possible structures and henoe 
make the search easier* Thus, when a proposed oonneotlon is tested 
with the "Test for possibility", it is rejected if making the 
connection would violate the tree constraint by introducing loops, 
even though the dictionary finds the connection acceptable* 

If we consider interpretations which are graphs restricted 
only in that at most one label of a given type may exist in each 
direction between any two word Instances, then the number of 

possible structures, assuming no constraints imposed by the dictionary, 

* 

is L Nf N -l ) f \ , where L is the number of labels and N the 

fuKlr-I') ) 

number of word tokens in the sentence* If the dictionary allows on 

the average five labels per word (as in the experiment reported later) 

the number of possible combinations is on the order of 10*^0, If we 

require that the structure be a tree, so that each word has at most 

one governing word, the number of possible structures is reduced to 
N1L ( M -l) 2 (N-8) # 

With L ■ 5 and N • 10, the number of possible trees 
is on the order of 10 11 . 

The dictionary * In this program, no distinction is made 
between function words and referent words* All words in an input 
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string are found In the dictionary* and all ocour in the resulting 
interpretation. To store information about the possible structural 
connections between each pair of words would require an excessive 
amount of storage space# Instead* each word has associated 
information which specifies which labels may be employed in 
dependency relations involving the given word# In particular* each 
word has two associated lists# List D3 for word W contains all 
labels which may be attached to arrows with W at the tall (dependent) 
end; list D4 for word W contains all labels which may be attached 
to arrows with W at the head (governing) end# In testing to determine 
whether a connection involving label X may be made between words W 
and Y with W being dependent on Y* a positive answer is made only 
if X occurs on the D3 list of W and on the D4 list of Y# If X^ 
is present on both lists the "Test for possibility” yields the 
answer "Possible”; if X is absent from one or both of the lists, the 
test, yields the answer "Impossible”, unless one of the lists involved 
is non-existent (indicating an unknown word), in which case the 

; 

answer is "Unknown”. As noted above* a connection must also satisfy 

{ 

* t 

j certain structural requirements in order to be acceptable# 

S It should be noted that the above manner of storing 

» 

information is less restrictive than would be the case if 

i 

i 

I information were stored on the basis of word pairs# Thus the 
dictionary writer might wish to state that "green" may depend 
on "grass" via the label "color" and the "white" may depend on 
"snow" by the label "color"# Using the above scheme* the resulting 
dictionary would allow "green snow" and "white grass". If this 
• possibility is to be ruied out* two color labels must be used. 

o 
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The syntax directory . In JIGSAW-1, syntax routines are 
stored at the terminal nodes of a tree. The non- terminal nodes 

1 • 

of the tree have associated tests. These tests may be any routines , 

1 

1 

which produce single symbols as output; in fact they are selected 
from a list of tests supplied by the programmer and are not 
generated by JIGSAW-1, Typically, the tests ask questions about 
partial interpretations and the answers to the questions uirect 
the program to ttle syntax routine which defines the types of 
further structural connections which the program will propose for 
the disposal of the partial interpretation which was used as the 
entry to the tree. Typical tests are: "Is the interpretation a 

single word or a more complex structure?" (answer: simple, complex); 

"What is the word which is at the head of the interpretation?" 

t 

(answer: a word type); "What is the label which is attached to 

the first level connection?" (answer: a label name); "How deep 

is the interpretation?" (answer: an integer). 

When a partial interpretation is submitted to the syntax 
tree, the first question is asked of it. The result of this test 
selects the branch which leads to another test, and so forth, 
until a syntax routine is retrieved. Executing the syntax routine 
selects the appropriate proposals and attaches this information to 
the partial interpretation where it is carried for later use. 

In the experiment reported later the tests in the syntax tree 
ask only about the head of the interpretation and not about 
substructure. 

This method of information retrieval is patterned after 
the EPAM theory of verbal learning as developed by Feigenbaum (i5f;). 

ERIC 
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The major feature of such a storage device is that the sequence of 
tests %hloh defines the retrieval properties is stored as a data 
structure which may be dynamically altered by the program* Typically 
the alterations are effected in order to adapt to a particular 
retrieval task with which the program is momentarily faced* Thus 
changes In the tree may bring about unexpected consequences which 
are felt when the program faces a new task* The tree thus brings 
about discrimination and generalization learning* In the context 
of human rote memorization tasks , the EPAM theory has demonstrated * 
learning behavior remarkably similar to that displayed by humans 
as reported In the extensive literature on human verbal learning* 

In JIGSAW-1 , which has no learning capabilities, the 
full vocabulary and associated syntax routines are given to the 
program at the outset* A subroutine grows a syntax tree In such a 
manner that each word Is sorted to an unique terminal at which Is 

\ 

placed its syntax routine* The algorithm which grows the tree 
sorts the given word in the tree. If an unique terminal is found, 
the routine Is finished* If not, an attempt Is made to find, from 
the given set of tests, a test which when added will discriminate 
the given word from the others with which It Is confused* This 
Is always possible due to the way In which the tests are defined* 
However, the list of tests is ordered from general to specific 
so that the algorithm examines general features of the structure first. 
The proposals which are selected and marked by a syntax 

, i /> 

; routine 1 re similar In content to the Information found In the 

r ** 

dictionary* A proposal Is of the form "Set up an expectation 
r that subsequently a structure (perhaps a single word) will be 

o 

ERIC 



encountered which can be combined with the present structure in 
suoh a manner that the present structure is dependent (governs) the 
expected structure by way of the label X w * A single syntax 
routine may mark any number of such proposals* 

Cognitive limits * The limitations placed upon JIGSAW-1 are 
that the number of partial interpretations must not exceed a small 
number (which is parameter controlled, usually set at seven) and that 
an attempt should be made to construct a single connected 
interpretation for a single Input string* As indicated below, if a 
limit is exceeded, the program attempts to force a connection 
which has not been proposed or which is not compatible with the 
dictionary* Such attempts may fall, in which case the program 
gives up* 

Initializing the program * The program may be initially 
supplied with any amount of information about the language to be 

\ 

processed* Some information must be supplied if the program is 
to perform other than at random* If no information involves 
distinguishing partial interpretations on the basis of their 
substructures, the program may be initialized by a simple algorithm, 
which has been employed in the experiment described in this paper* 

The algorithm for Initialization proceeds as follows* 

Select a corpus of sentences (or other units) from the 
language* Using your linguistic knowledge and intuition, draw a 
labeled dependency tree for each sentence, supplying whatever 
labels necessary* For each word in the vocabulary note all sites 
where the word occurs at the tall of an arrow. Form a list (the 
D3 list) of all of the labels associated with such sites* Each 
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label Is to occur on the list only once In spite of multiple 
ooourenoes In the labeled dependency trees; the order of the labele 
on the lists Is arbitrary. Next note all sites where the word 
occurs at the head of an arrow and form the D4 list In a similar 

! 

manner. Add this Information to the dictionary In association 
with the word. 

Next consider each entry on the D3 list In turn. Determine 
I; whether. In any Instance where the associated site occurs, the 
given word precedes (in the Input sentence) by one or more word 
positions the word which appears at the other end of the dependency 
relation. If so, add the label to a list called the Q1C1 list, 
and consider the next D3 entry. If not, skip the label and consider 
the next D3 entry. When the D3 list Is exhausted, consider the 
D4 list In like manner, this time forming another list, the Q1G0 
list. Associate lists Q1Q9 and Q191 with the syntax routine which 

V - 

w 

Is to correspond to the given word. Enter the word and Its 

•i 

syntax routine Into the syntax tree by means of the tree growing 
subprogram. 

Program outline . After the syntax tree Is grown and 
the dictionary read Into memory, control Is transferred to the main 
executive, E2, whose flowchart appears In Figure 3* E2 selects 
the next sentence to be processed and sequentially presents each 
word In the sentence to the main subroutine, E20: PROCESS CURRENT 
PHRASE. E20 either combines the current word with structures 
previously held In the Immediate memory (iM) or reports failures 
after retrieving and executing Its associated syntax routine. 

Routine E23 Is executed to add the word to the IN and. If IM Is 

> 
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Figure 3. E2, Main Flow of JIGSAW-1 
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full, to force a connection# When the sentence Is complex. -d, 
routine E23 attempts to oomblne the members of ZM Into a single struc- 
ture# The result Is then submitted to the teacher, T20, and if It 
Is acceptable, the learning routine, E26, Is executed# Then the next 
Input is selected# 

The heart of JIQSAW-1 is*E20 and Its three associated 
subroutines, 03, E21, and E24. 03 generates (in the IPL sense) each 

proposal associated with the phrases held In IH# The order In 
which generation occurs Is parameter controlled# In the experiment 

a 

reported, the IM Is examined from most recent to most remote 
phrase, and for each phrase, each proposal which would use the 
current phrase as a governor Is selected In turn# When these 

f 

proposals are exhausted, the IM Is again scanned In the same 
direction and proposals are generated which would make the 
current phrase dependent# Each proposal Is presented to one of x 
the subroutines E24 or E21, whose flowcharts appear In Figures 4 and 
5. The subroutine may either terminate the generation of proposals 
or request the next proposal# As seen In Figures 4 and 5# generation 
Is continued If the proposal Is rejected or If the proposal Is used 
to employ the current phrase as a governor# If a proposal which 
employs the current phrase as a dependent Is used, the current 
phrase becomes part of another structure which Is stored In the IM. 

n 

: The new structure Is sorted in the syntax tree to retrieve a new 

W 

set of proposals, and generation Is terminated, thus returning 
control to E2 which selects the next word# 

i 

r 1 

r;! E24 checks the feasibility of the proposed structural 

iji 

", chang es by two tests. The first checks to see that no rules' of 
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structure formation will be violated (in this case, the rule that 
the proposed structure must be a tree) and the second checks the 
proposal for consistency with the dictionary# If both tests 
are passed, the change is carried out# 

If a change in structure is accomplished by E24, E20 
is finished# However, if no change is made by E2^, JIGSAW-1 
makes a more concerted effort to accomplish something by regenerating 
the proposals and executing a more lenient analysis, E21# Even 
though a proposal is not clearly acceptable to the dictionary, 

E21 will force the proposed restructuring if it is not definitely 
rejected by the dictionary# This occurs at present only in the 
case where one of the lists, D3 or D4, for one or both of the words, 
is empty, indicating that the dictionary has no information concerning 
the relevant aspects of the words involved# 

An additional complexity should be mentioned# A phrase .Is 
stored in the IM by placing the name of the tree in a memory 
register# A proposal may suggest that the word at the head of the 
structure is to be combined as a dependent or governor, or it 
may suggest that one of the words already dependent on the head of 
the phrase is to be used as a governor of the current phrase. 
Information concerning each proposal is formed into a list, and 
the list of proposals is associated with the name of the phrase# 

Since the generator, G5, produces proposals in the order in which 
they occur on the list, their placement is crucial# Implicit in 
JIGSAW-1 is the assumption that the language being processed is 
predominately an immediate constituent language . Thus, the order 
of the proposals is constructed so that proposals involving more 
recent words are placed nearer the top of the list of proposals. 
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whether or not the words are near the top or bottom of the phrase 
whose name appears in the IM. 

Two examples. JIGSAW-1 produces a trace at the level of 
description presented in the flowcharts. The trace and the results 
of the processing of two sentences are produced in Figure 6. In 
conjunction with the flowcharts, the trace is self-explanatory. The 
output encodes the labeled dependency trees in a functional 
notation. Associated with each word is a pair of parentheses 
which enclose the branches of the tree which immediately proceed 
from the word. Each branch is identified by a code of the form 
Fxx A( ) B( )etc. " The label is denoted by Fxx (the letter 'F' 
followed by a decimal integer) and A, B, etc. are the words at. 
the ends of the branches so labeled. Within the list of branches 
associated with the word, the branches with distinct labels are 

separated by commas. The following example illustrates this 
notation 

labeled dependency tree. bit 




functional code for the above tree. 

(FO--the( )f j P0 ““ the ( )*Fl--quick( ) --brown ( ) )#F3 — postman 

The correct” interpretations of the two example sentences 
are depicted in the Appendix, where they are labeled, "sentence 0” 
and sentence 1 . it will be seen that sentence 0 was correctly 
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GENERATE THE FOLLOWING PROPOSALS FOR SUBPR0CE55 tt* 

WORD -DECIDED .ATT -F6. CURRENT TO BE VALU 

IMPOSSIBLE. EXIT TO GENERATE NEXT. 

generate THE FOLLOWING PROPOSALS FOR subprocess 

WORD ^DECIDED .ATT =F6. CURRENT TO BE VALU 

IMPOSSIBLE. EXIT TO GENERATE NEXT. cmtr y 
023. ADD CURRENT PHRASE AS MOST RECENT IM ENT Y. 

CURRENT WORD IS. ..TABLE 
Q22. DO SYNTAX OF CURRENT. 

PR GEnIra?E R ?hE T FOLlSwING PROPOSALS FOR SUBPROCESS E24 
WORD *T0 .ATT *F1. CURRENT TO BE SYMB 
♦POSSIBLE. ASSIGN -TO- TO -TABLE- VIA -Fl 
007. MAKE 1X50 A VALUE OF 1X60 ON 1X70. 



1X51 



E21 
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012 . 
006 • 
036. 
013. 
Q22 . 



REMOVE 

REMOVE 

REMOVE 

DELETE 



NEED OF SYMBOL FOR 1X60 ON 1X50. 

NEED OF SYMBOL FOR 1X60 BY 1X50 AS INDICATED ON SUPERPHRASE 
NEED FOR ALL SYMBOLS FOR 1X50 AS INDICATED ON 1X51. 
SUPERPHRASE FROM IM* MOST RECENT OCCURRENCE ONLY. 



1X51 



DO SYNTAX OF CURRENT. 

WORD “DECIDED * ATT = F6 *CURRENT TO BE VALU 
♦POSSIBLE. ASSIGN -TABLE- TO -DECIDED- VIA -F6 



MAKE 1X70 A VALUE OF 
REMOVE NEED OF VALUE 
REMOVE NEED OF VALUE 
REMOVE ALL NEEDS FOR 
DO 



1X60 ON 1X50. 

FOR 1X60 ON 1X50. 
FOR 1X60 BY 1X50 AS 
SYMBOL BY CURRENT. 



SUBPROCESS 
BE VALU 



008 . 

010 . 

005. 

038. 

034. DO SYNTAX OF SUPERPHRASE. 

CURRENT WORD IS. ..THE 

022. DO SYNTAX OF CURRENT. 

PROCESS CURRENT PHRASE. 

GENERATE THE FOLLOWING PROPOSALS FOR 
WORD =TABLE * ATT =F59. CURRENT TO 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD =TABLE * ATT sF8*CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD =TABLE * ATT =F10*CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD “DECIDED *ATT =F6*CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

GENERATE THE FOLLOWING PROPOSALS FOR SUBPROCESS 
WORD =TABLE * ATT =F59*CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD STABLE * ATT =F8 *CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD STABLE * ATT sF10*CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD “DECIDED * ATT “F6*CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

023. ADD CURRENT PHRASE AS MOST RECENT IM ENTRY. 
CURRENT WORD IS...BILL 

022. DO SYNTAX OF CURRENT. 

PROCESS CURRENT PHRASE. 

GENERATE THE FOLLOWING PROPOSALS FOR SUBPROCESS 
WORD “THE *ATT “F70*CURRENT TO BE SYMB 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD =THE *ATT =F*CURRENT TO BE SYMB 
♦POSSIBLE. ASSIGN -THE- TO -BILL- VIA -F 
007 . MAKE 1X50 A VALUE OF 1X60 ON 1X70. 



INDICATED ON SUPERPHRASE 1X51 



E24 



E21 



E24 



012 . 
006 . 
036. 
013. 
022 . 



1X51 



REMOVE NEED OF SYMBOL FOR 1X60 ON 1X50. 

REMOVE NEED OF SYMBOL FOR 1X60 BY 1X50 AS INDICATED ON SUPERPHRASE 

REMOVE NEED FOR ALL SYMBOLS FOR 1X50 AS INDICATED ON 1X51. 

DELETE SUPERPHRASE FROM IM* MOST RECENT OCCURRENCE ONLY. 

DO SYNTAX OF CURRENT. 

WORD “TABLE * ATT =F59*CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD “TABLE * ATT =F8 *CURRENT TO BE VALU 
♦POSSIBLE. ASSIGN -BILL- TO -TABLE- VIA -F8 
008. MAKE 1X70 A VALUE OF 1X60 ON 1X50. 

010. REMOVE NEED OF VALUE FOR 1X60 ON 1X50. 

Q05. REMOVE NEED OF VALUE FOR 1X60 BY 1X50 AS INDICATED ON SUPERPHRASE 1X51* 

038. REMOVE ALL NEEDS FOR SYMBOL BY CURRENT. 



{ me 

UHI 



HUM 



mmmmm 
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034. DO SYNTAX OF SUPERPHRASE. 

CURRENT WORD IS,. .UNTIL 
022.. DO SYNTAX OF CURRENT. 

PROCESS CURRENT PHRASE. 

GENERATE THE FOLLOWING PROPOSALS FOR SUBPROCESS E24 
WORD -TABLE tATT -F59tCURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD -TABLE tATT -F10 tCURRENT TO BE VALU 
•POSSIBLE. ASSIGN -UNTIL- TO -TABLE- VIA -F10 
008. MAKE 1X70 A VALUE OF 1X60 ON 1X50. 

010, REMOVE NEED OF VALUE FOR 1X60 ON 1X50. 

005. REMOVE NEED OF VALUE FOR 1X60 BY 1X50 AS INDICATED ON SUPERPHRASE 1X5 
038. REMOVE ALL NEEDS FOR SYMBOL BY CURRENT. 

034. DO SYNTAX OF SUPERPHRASE. 

CURRENT WORD IS... FURTHER 

022. DO SYNTAX OF CURRENT. 

PROCESS CURRENT PHRASE. 

GENERATE THE FOLLOWING PROPOSALS FOR SUBPROCESS E24 
WORD -UNTIL tATT -F12 tCURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD -TABLE tATT »F59tCURRENT TO BE VALU. 

IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD -DECIDED tATT »F6tCURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

GENERATE THE FOLLOWING PROPOSALS FOR SUBPROCESS E21 
WORD -UNTIL tATT -F12 tCURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD -TABLE tATT *F59tCURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD -DECIDED tATT «F6tCURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

023. ADD CURRENT PHRASE AS MOST RECENT IM ENTRY. 

CURRENT WORD IS. • .NOT ICE 

022. DO SYNTAX OF CURRENT. 

PROCESS CURRENT PHRASE. 

GENERATE THE FOLLOWING PROPOSALS FOR SUBPROCESS E24 
WORD -FURTHER tATT *F14tCURRENT TO BE SYMB 
•POSSIBLE. ASSIGN -FURTHER- TO -NOTICE- VIA -F14 

007. MAKE 1X50 A VALUE OF 1X60 ON 1X70. 

012. REMOVE NEED OF SYMBOL FOR 1X60 ON 1X50. 

006. REMOVE NEED OF SYMBOL FOR 1X60 BY 1X50 AS INDICATED ON SUPERPHRASE IX 

036. REMOVE NEED FOR ALL SYMBOLS FOR 1X50 AS INDICATED ON 1X51. 

013. DELETE SUPERPHRASE FROM IMt MOST RECENT OCCURRENCE ONLY. 

022. DO SYNTAX OF CURRENT. 

WORD -UNTIL tATT -F12 tCURRENT TO BE VALU 
•POSSIBLE. ASSIGN -NOTICE- TO -UNTIL- VIA -F12 

008. MAKE 1X70 A VALUE OF 1X60 ON 1X50. 

010. REMOVE NEED OF VALUE FOR 1X60 ON 1X50. 

QOS. REMOVE NEED OF VALUE FOR 1X60 BY 1X50 AS INDICATED ON SUPERPHRASE 1X5 

038. REMOVE ALL NEEDS FOR SYMBOL BY CURRENT. 

034. DO SYNTAX OF SUPERPHRASE. 

END OF SENTENCE..*.. 

023 . ADD CURRENT PHRASE AS MOST RECENT IM ENTRY. 

»#»»» 

X0001 
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is 



YOU 



WERE 



IN 



SEARCH 



OF 



IS 



ON 



THE 



CURRENT SENTENCE 
THE NOTICE 

TABLE • ! 

CURRENT WORD IS..*THE 
022. DO SYNTAX OF CURRENT. ( 

PR generate R the T following proposals for subprocess E24 

GENERATE THE FOLLOWING PROPOSALS FOR SUBPROCESS E21 
Q23. ADD CURRENT PHRASE AS MOST RECENT IM ENTRY. 

CURRENT WORD IS...NOTICE 
022. DO SYNTAX OF CURRENT. 

PROCESS CURRENT PHRASE. _ ' 

GENERATE THE FOLLOWING PROPOSALS FOR SUBPROCESS E24 
WORD =THE tATT =F70tCURRENT TO BE SYMB 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD =THE tATT =F. CURRENT TO BE SYMB 
♦POSSIBLE. ASSIGN -THE- TO -NOTICE- VIA -F 
► MAKE 1X50 A VALUE OF 1X60 ON 1X70. 

00 6 : SI SIIS OF IS £ S3 BY III *AS INDICATED ON SUPERPHRASF IXtl. 

SS: SI ^a$I l fK SSKSSeV?? 1 - 

022. DO SYNTAX OF CURRENT. 



007 

012 






SUBPROCESS 
BE SYMB 



E24 



E21 



023. ADD CURRENT PHRASE AS MOST RECENT IM ENTRY 
CURRENT WORD IS. ..YOU 

022. DO SYNTAX OF CURRENT. 

PROCESS CURRENT PHRASE. 

GENERATE THE FOLLOWING PROPOSALS FOR 
WORD =NOTICE tATT =F3tCURRENT TO 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD =NOTICE tATT =F16tCURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD sNCTICE tATT =F36tCURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

GENERATE THE FOLLOWING PROPOSALS FOR SUBPROCESS 
WORD =NOT ICE tATT «F3tCURRENT TO BE SYMB 
IMPOSSIBLE. EXIT TO GENERATE NEXT, 

WORD =NOTICE tATT *F16tCURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD ^NOTICE tATT *F36tCURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

023. ADD CURRENT PHRASE AS MOST RECENT IM ENTRY. 
CURRENT WORD IS.. .WERE 

022. DO SYNTAX OF CURRENT. 

PROCESS CURRENT PHRASE. __ 

GENERATE THE FOLLOWING PROPOSALS FOR SUBPROCESS E24 
WORD =YOU tATT *F25»CURRENT TO BE SYMB 

IMPOSSIBLE. EXIT TO GENERATE NEXT. 

=F24tCURRENT TO BE SYMB 

TO GENERATE NEXT. 
s p33 tCURRENT TO BE SYMB 
TO GENERATE next. 

*F41 tCURRENT TO BE SYMB 
TO GENERATE NEXT. 

=F34tCURRENT TO BE SYMB 
TO GENERATE NEXT. 



WORD =YOU 
IMPOSSIBLE. 
WORD »YOU 
IMPOSSIBLE. 
WORD »YOU 
IMPOSSIBLE* 
WORD =YOU 
IMPOSSIBLE. 



tATT 

EXIT 

tATT 

EXIT 

tATT 

EXIT 

tATT 

EXIT 



o 

:RiC 



hi 
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WORD =YOU fATT s F3f CURRENT TO BE SYMB 
♦POSSIBLE.ASSIGN -YOU- TO -WERE- VIA -F3 
007* MAKE 1X50 A VALUE OF 1X60 ON 1X70. 

012* REMOVE NEED OF SYMBOL FOR 1X60 ON 1X50. 

Q06. REMOVE NEED OF SYMBOL FOR 1X60 BY 1X50 AS INDICATED ON SUPERPHRASE 1X51. 

Q36. REMOVE NEED FOR ALL SYMBOLS FOR 1X50 AS INDICATED ON 1X51. 

013, DELETE SUPERPHRASE FROM IM, MOST RECENT OCCURRENCE ONLY. 

022. DO SYNTAX OF CURRENT. 

WORD -NOTICE fATT -F3 , CURRENT TO BE SYMB 
♦POSSIBLE. ASSIGN -NOTICE- TO -WERE- VIA -F3 

007. MAKE 1X50 A VALUE OF 1X60 ON 1X70. 

012. REMOVE NEED OF SYMBOL FOR 1X60 ON 1X50. , 

006. REMOVE NEED OF SYMBOL FOR 1X60 BY 1X50 AS INDICATED ON SUPERPHRASE 1X51, 

Q36. REMOVE NEED FOR ALL SYMBOLS FOR 1X50 AS INDICATED ON 1X51. 

013, DELETE SUPERPHRASE FROM IM, MOST RECENT OCCURRENCE ONLY. 

022. DO SYNTAX OF CURRENT. 

WORD -NOTICE , ATT =F16, CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD =NOT ICE , ATT -F36, CURRENT TO BE VALIT 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

023. ADD CURRENT PHRASE AS MOST RECENT IM ENTRY. 

CURRENT WORD IS...IN 

022. DO SYNTAX OF CURRENT. 

PROCESS CURRENT PHRASE. 

GENERATE THE FOLLOWING PROPOSALS FOR SUBPROCESS E24 
WORD -WERE ,ATT -F5 , CURRENT TO BE VALU 
♦POSSIBLE. ASSIGN -IN- Tp -WERE- VIA -F5 

008. MAKE 1X70 A VALUE OF 1X60 ON 1X50. 

Q10. REMOVE NEED OF VALUE FOR 1X60 ON 1X50. 

005. REMOVE NEED OF VALUE FOR 1X60 BY 1X50 AS INCICATED ON SUPERPHRASE 1X51. 

038 • REMOVE ALL NEEDS FOR SYMBOL BY CURRENT. 

034. DO SYNTAX OF SUPERPHRASE. 

CURRENT WORD IS... SEARCH 
022. DO SYNTAX OF CURRENT. 

PROCESS CURRENT PHRASE. _ 

GENERATE THE FOLLOWING PROPOSALS FOR SUBPROCESS E24 
WORD -IN * ATT »F18f CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD -IN fATT -F55, CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD -IN fATT -F15, CURRENT TO BE VALU 
♦POSSIBLE.ASSIGN -SEARCH- TO -IN- VIA -F15 
Q08. MAKE 1X70 A VALUE OF 1X60 ON 1X50. 

Q10. REMOVE NEED OF VALUE FOR 1X60 ON 1X50. 

Q05. REMOVE NEED OF VALUE FOR 1X60 BY 1X50 AS INDICATED ON SUPERPHRASE 1X51. 
038. REMOVE ALL NEEDS FOR SYMBOL BY CURRENT. 

Q34. DO SYNTAX OF SUPERPHRASE. 

CURRENT WORD IS. ..OF , 

022. DO SYNTAX OF CURRENT. 

PROCESS CURRENT PHRASE. 

GENERATE THE FOLLOWING PROPOSALS FOR SUBPROCESS E24 
WORD -SEARCH , ATT *F56,CURRENT TO BE VALU 

IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD -SEARCH , ATT -F19, CURRENT TO BE VALU 
♦POSSIBLE.ASSIGN -OF- TO -SEARCH- VIA -F19 
008. MAKE 1X70 A VALUE OF 1X60 ON 1X50. 

O 

ERIC 
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OlO- REMOVE NEED OF VALUE FOR 1X60 ON 1X50* 

Q05. REMOVE NEED OF VALUE FOR 1X60 BY 1X50 AS INDICATED ON SUPERPHRASE 
036* REMOVE ALL NEEDS FOR SYMBOL BY CURRENT* 

034* DO SYNTAX OF SUPERPHRASE# 

CURRENT WORD IS...IS 
022# DO SYNTAX OF CURRENT# 

PROCESS CURRENT PHRASE. 

GENERATE THE FOLLOWING PROPOSALS FOR SUBPROCESS E24 t 
WORD “SEARCH *ATT =F56*CURRENT TO BE VALU 
IMPOSSIBLE# EXIT TO GENERATE NEXT* 

WORD “IN *ATT =F18*CURRENT TO BE VALU 
IMPOSSIBLE# EXIT TO GENERATE NEXT# 

WORD “IN *ATT “F 55 .CURRENT TO BE VALU 
IMPOSSIBLE# EXIT TO GENERATE NEXT# 

*F16 .CURRENT TO BE VALU 
GENERATE NEXT# 

“F36 .CURRENT TO BE VALU 
GENERATE NEXT# . 

9 ATT =F5 .CURRENT TO BE VALU 
EXIT TO GENERATE NEXT* 



WORD “NOTICE .ATT 
IMPOSSIBLE. EXIT TO 
WORD “NOTICE .ATT 
IMPOSSIBLE. EXIT TO 
WORD “WERE 
IMPOSSIBLE. 



GENERATE THE FOLLOWING PROPOSALS FOR SUBPROCESS E21 
WORD “SEARCH .ATT =F56. CURRENT TO BE VALU 
IMPOSSIBLE# EXIT TO GENERATE NEXT# 

WORD “IN 9 ATT “F18.CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT* 

WORD “IN * ATT “F 55 .CURRENT TO BE VALU 
IMPOSSIBLE* EXIT TO GENERATE NEXT* 

=F16. CURRENT TO BE VALU 
GENERATE NEXT* 

=F36 .CURRENT TO BE VALU 
GENERATE NEXT. 

,ATT =F 5 .CURRENT TO BE VALU 
EXIT TO GENERATE NEXT* 



WORD “NOTICE .ATT 
IMPOSSIBLE# EXIT TO 
WORD “NOTICE * ATT 
IMPOSSIBLE# EXIT TO 
WORD “WERE 
IMPOSSIBLE# 



SUBPROCESS 

SYMB 



023# ADD CURRENT PHRASE AS MOST RECENT IM ENTRY# 
CURRENT WORD IS###ON 
022# DO SYNTAX OF CURRENT# 

PROCESS CURRENT PHRASE# 

GENERATE THE FOLLOWING PROPOSALS FOR 
WORD “IS .ATT “F 54 .CURRENT TO BE 
IMPOSSIBLE# EXIT TO GENERATE NEXT* 

WORD “IS .ATT =F 3 . CURRENT TO BE VALU 
IMPOSSIBLE* EXIT TO GENERATE NEXT* 

WORD “IS .ATT =F 5 . CURRENT TO BE VALU 
•POSSIBLE. ASSIGN -ON- TO -IS- VIA -F5 
008. MAKE 1X70 A VALUE OF 
REMOVE NEED OF VALUE 
REMOVE NEED OF VALUE 
REMOVE ALL NEEDS FOR 
DO SYNTAX OF SUPERPHRASE# 

WORD IS* • • THE 
SYNTAX OF CURRENT* 



E24 



010 * 
005* 
038* 
034* 
CURRENT 
022* DO 



1X60 ON 1X50* 

FOR 1X60 ON 1X50. 
FOR 1X60 BY 1X50 AS 
SYMBOL BY CURRENT* 



INDICATED ON SUPERPHRASE 



PROCESS CURRENT PHRASE. . 

GENERATE THE FOLLOWING PROPOSALS FOR 
WORD “IS .ATT “F 54 .CURRENT TO BE 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD “ON .ATT »F48. CURRENT TO BE VALU 



SUBPROCESS 

SYMB 



E24 




a 

1X51# 



1 

. 



3 






1X51# 
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IMPOSSIBLE# EXIT TO GENERATE NEXT# 

WORD =ON * ATT =F20*CURRENT TO BE VALU 
IMPOSSIBLE# EXIT TO GENERATE NEXT# 

WORD *IS *ATT *F3 ^CURRENT TO BE VALU 
IMPOSSIBLE# EXIT TO GENERATE NEXT. 

WORD =IS * ATT =F67 ^CURRENT TO BE VALU 
IMPOSSIBLE# EXIT TO GENERATE NEXT# 

WORD *IS * ATT =F5 ^CURRENT TO BE VALU 
IMPOSSIBLE# EXIT TO GENERATE NEXT# ' 

WORD -SEARCH *ATT =F56*CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD = I N * ATT =F18*CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT# | 

WORD = I N #ATT =F55*CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD ^NOTICE *ATT =F16*CURRENT TO BE VALU 
IMPOSSIBLE# EXIT TO GENERATE NEXT. i 

WORD ^NOTICE ♦ ATT =F36*CURRENT TO BE VALU. ! 

IMPOSSIBLE# EXIT TO GENERATE NEXT. 

WORD =WERE ♦ ATT S F5 *CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

GENERATE THE FOLLOWING PROPOSALS FOR SUBPROCESS E21 
WORD s I S * ATT *F54»CURRENT TO BE SYMB 
IMPOSSIBLE# EXIT TO GENERATE NEXT. 

WORD »ON » ATT 3FA8*CURRENT TO BE VALU 
IMPOSSIBLE-# EXIT TO GENERATE NEXT# 

WORD sON » ATT 3F20*CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD 3 i S » ATT 3F3,CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD =IS # ATT sF 67 *CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD =IS * ATT 3F5*CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD sSEARCH »ATT 3F56#CURRENT TO BE VALU 
IMPOSSIBLE# EXIT TO GENERATE NEXT# 

WORD —IN » ATT 3F18*CURRENT TO BE VALU 
IMPOSSIBLE# EXIT TO GENERATE NEXT# 

WORD —IN *ATT 3F55*CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD 3NOTICE »ATT *F16*CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD *NOT ICE *ATT sF36*CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD *WERE * ATT *F5#CURRENT TO BE VALU 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

023. ADD CURRENT PHRASE AS MOST RECENT IM ENTRY# 

CURRENT WORD IS# • .TABLE 
022# DO SYNTAX OF CURRENT# 

PROCESS CURRENT PHRASE# 

GENERATE THE FOLLOWING PROPOSALS FJR SUBPROCESS E24 
WORD *THE *ATT =F70*CURRENT TO BE SYMB 
IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD sTHE * ATT =f, CURRENT TO BE SYMB 1 

♦POSSIBLE .ASSIGN -THE- TO -TABLE- VIA -F 
007# MAKE 1X50 A VALUE OF 1X60 ON 1X70# 



I 
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012. REMOVE NEED OF SYMBOL FOR 1X60 ON 1X50. 

006. REMOVE NEED OF SYMBOL FOR 1X60 BY 1X50 AS INDICATED ON SUPERPHRASE 1X51. 

036. REMOVE NEED FOR ALL SYMBOLS FOR 1X50 AS INDICATED ON 1X51. 

013. DELETE SUPERPHRASE FROM IM. MOST RECENT OCCURRENCE ONLY. 

022. DO SYNTAX OF CURRENT. 

WORD »I S * ATT »F54. CURRENT TO BE SYMB 
IMPOSSIBLE. EXIT TO GENERATE NEXT • 

WORD =0N * ATT =F48*CURRENT TO BE VALU 

IMPOSSIBLE. EXIT TO GENERATE NEXT. 

WORD =0r- .ATT =*F20. CURRENT TO BE VALU | 

#POSS I BLE .ASSIGN -TABLE- TO -ON- VIA -F20 
008. MAKE 1X70 A VALUE OF 1X60 ON 1X50, 

Q10. REMOVE NEED OF VALUE FOR 1X60 ON 1X50. 

Q05. REMOVE NEED OF VALUE FOR 1X60 BY 1X50 AS INDICATED ON SUPERPHRASE 1X51. 

038. REMOVE ALL NEEDS FOR SYMBOL BY CURRENT. 

034. DO SYNTAX OF SUPERPHRASE. 

END OF SENTENCE. •••• 

023. ADD CURRENT PHRASE AS MOST RECENT IM ENTRY,. 

##### 

X0001 

##### ! 

WERE ( F3 — 1 YOU! I— NOTICE! F — THE ( ) ) .F5““IN( F15~SEARCH( F 19— 
OF(I)I) 



***** 

X0002 

***** 

ISC F5— 0N( F20— TABLE! F— THE C ) 1 1 ) 
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***** 

X0070 
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processed by JIGSAW-1 while sentence 1 was not. It is instructive 

to analyze the failure in the second example. I 

Two disjoint pieces resulted because "notice" could not 
be assigned to "is" since this would violate the tree constraint. 

This is a direct result of the incorrect assignment of "notice" 
as a dependent of "were" rather than the other way around. The 
assignment actually made was proposed first since "were" occurs 
later in the sentence and current words are used as 'governors 
before they are used as dependents. The assignment made uses 
label F3, which reflects a sense in which "notice" acts as a 
subject of the verb "were", as in "The notice were late". This 
particular difficulty could be eliminated by providing a larger 
selection of labels so that subjects and verbs are forced to agree 
in number. However, this would defeat the purpose of the over- 
general linguistic description. Actually, the corpus from which 
the program was initialized did not contain the "ungrammatical" 
construction. "notice were". It did, however, contain a sentence 
in which "notice" is a subject of a copulative verb and a sentence 
in which "were" is used as a copulative verb, but with another 
subject. Since the dictionary contains no information about 
particular word pairs, the assignment of "notice" to "were" 

is not rejected by the dictionary. 

If such situations are not to be ruled out by the dictionary 

how can such clumsy failures be avoided? The answer lies in the 
syntax tree. Somehow, the program should know that "were" is 
no longer acceptable as the verb for "notice" since the former j 

already has a subject, namely "you". Furthermore, no conjunction j 



exists to tie Notice" and "you 11 into a compound subject for "were • 
But unless the syntax tree oontalns tests whioh deteet the sub- 
structure of the "were "-phrase, these facts will go undetected 
and the resulting error is perfectly natural# This example 
indicates the need for subphrase syntax , not present in JIGSAW-1. 

The problem is, further discussed in the ensuing experimental report. 

It should be added, however, that the sentences employed 
as examples are fairly sophisticated examples of English. 

JIGSAW-1* s aspiration level is such as to be undaunted by this 
failure. A program without subphrase syntax will surely be able 
to handle simple sentences of the sort used and understood by a 
child of three or four. Clearly, the program must have the ability 
to learn subphrase syntax if it is to progress to adult linguistic 
abilities. But such pr 9 gress, if possible within JIGSAW'S 
framework, will undoubtedly require a careful and elaborate 
education process of an order of magnitude comparable to that 
employed by humans. To expect otherwise is perhaps asking too much 
of a science which is only beginning to learn how to babble. 
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i 

AN EXPERIMENT WITH JIGSAW- 1 

In order to explore the feasibility of the approach 
outlined in the previous sections, an experiment was performed 
on a small sample of English sentences. The 23 sentences used 
were composed and diagrammed by assistants unfamiliar with the 

1 

operation of JIGSAW-1. The assistants were instructed to prepare 
sentences of reasonable length such that the total vocabulary 
employed was less than 50 distinct words. The last condition was 
imposed to encourage the use of some words in a variety of syntactic 
and semantic contexts. The corpus produced was in no way edited 

* i 

by the programmer. 

The sentences are presented in diagrammed form in the 
Appendix. The dictionaipy and syntax routines were derived by the 
algorithm presented in a previous section; this material also 

t 

appears in the Appendix. It will be noted that the sentences 
employ some moderately complex constructions. It was not 
anticipated, and did not prove to be the case, that JIGSAW-1 was 
able to produce the sentence diagrams from which the linguistic 
description derived. The failures, however, point to the 
limitations of the method as presently constituted, and the 

successes give some indication of the extent to which word 

I 

position cues alone can direct linguistic processing. The results 
as produced by the program appear on the next pages. Brief comments 

1 

on each analysis follow. 
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Sentence 0 
Sentence 1 



Sentence 2 
Sentence 3 



Sentence 4 
Sentence 5 
Sentence 6 



Sentence 7 



Processed correctly. 

Error as noted in the previous section. This 
difficulty may be corrected by the addition of 
subphrase syntax (SPS). 1 

Processed correctly. * 

The program failed to handle the Compound 
predicate; this is typical behavior. JIGSAW-1 
does not understand English conjunct ions , and 
will assume (and form) a simple phrase without 
looking for conjunctions. This may be corrected 
by allowing tests on function Words to be used 
in the syntax tree. i 

Processed correctly. 

Processed correctly. 

"Table" was incorrectly connected to "decided" as 
an object rather than to "was" as a subject. This 
may be corrected either by SPS or a semantic 
check: One may decide to table, but one does 

not decide the table. , 

"The committee" is incorrectly used as a second 
object of "for". This reflects the frequent 
error of allowing proposals produced at a 
remote (early) point in the sentence to take . 
precedence over connections which would be 
proposed for the current word and could be 
filled by words immediately following. This 
may be corrected by SPS which removes some 
proposals once some action is taken. 
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Sentence 8 


Processed correctly* 


Sentence 9 


Processed correctly* 


Sentence 10 


Processed correctly* 


Sentence 11 


Again a compound predicate was handled incorrectly 

as in Sentence 3. Also "spend"-"little" was 

selected instead of "little'*-"t!ime" and "and"- 

"money" instead of "buy” -"money"; this may 

be remedied by SPS to remove the influence of 

remote connections, as noted in connection with 

• 

Sentence 7 . 

1 


Sentence 12 


Again, failure to handle compound predicates. 


Sentence 13 


Failure for reason given with Sentence 7. 


Sentence 14 


Processed correctly* 


Sentence 13 


"More"- ,, work" connection bears tl^e wrong label. 

This problem must be solved by a more sophisticated 
semantic dictionary or more Judicious selection 


Sentence 16 


of labels* 

"In"- "much" was selected instead of "in"- "make". 
This is also a problem of remote proposals 


Sentence 17 


dominating; see Sentence 7# » 

t 

The failure to produce a single structure iu uue 
to the incorrect structure "much"-"do" (instead 
of "much "-"work". This problem is more serious 
and must either be solved by more Judicious 
selection of labels in the corpus diagrams, SPS 
of a fairly complex sort, or a revision in the 
basic JIGSAW-1 order of examining proposals. 



Sentence 18 
Sentenoe 19 

Sentence 20 



Sentence 21 
Sentence 22 

Sentence 23 



Sentence 24 



Processed correctly. 

The failure here is traoeable to the difficulty 
experienced with compound predicates. 

Both instances of "it" have been combined with 
the same instance of "is' 5 . This may be remedied 
with SPS to eliminate remote connections , The 
reversal of the "is "-"and" cbnstruction is a more 
basic fault deriving from JIGSAW-l's strategy 
(in E24) of using the current symbol as a governor 
before attempting to use it as a dependent. 
Processed correctly. 1 

I 

The failure here is for the same reasons 

i 

outlined for Sentence 17. 

"It" was combined as the object of the first 
instance of "buy" rather than as the subject 
of the second instance of "buy". This may be 
corrected with SPS to suppress remote proposals, 
SPS to suppress remote proposals would also 
eliminate two errors in the processing of this 

sentence: the incorrect "little"-"spend" and 

! 

"time "-"in". Also the difficulty with compound 
predicates again appears. 



In summary, 10 of 25 sentences were processed correctly; of 
the remainder, all but two appear to be completely within the range of 
JIGSAW with an extension of the syntax tree to allow tests which deal 
with function words and the nature of the substructure of the phrase 
whose syntax routine is being recovered. 
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It remains to be determined (a) how the SPS capability 
is to be implemented, and (b) if JIGSAW can proceed with its 
learning strategy from partial information about a Corpus to a 
• state where it can handle the entire corpus* 



i 



o 



J 
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CURRENT 


SENTENCE IS..** 






THE 


COMMITTEE DECIDED 


TO TABLE 


THE 


FURTHER 


NOTICE 


XOOOl 

••••• 





BILL 



UNTIL 



t 



i 



DEC I DEO ( F4 — COMMITTEE C F — TH£!))«F6 — TABLE! FI—' TO||#F8— 
BILL! F— ' THE1 II »F10 — UNTIL! F12 — NOTICE! F14 — FURTHER! HIM 



***** 

X0070 

***** 



***! ) 



IN 



SEARCH 



OF 



IS 



CURRENT SENTENCE IS**** 

THE NOTICE YOU WERE 
TA3LE • 

*«««* 

X0001 
***** 

i WERE! F3— YOU! I— NOTICE! F— ' THE! M tF5— INI F15 
OF! mi 



ON 



THE 1 



•J 



—SEARCH! F19— 



***** 

X0002 

***** 

IS! F5— ON! F20— TABLE! F — THE! III! 



***** 

X0070 

***** 



***! > 



CURRENT SENTENCE IS..*. 
BILL THOUGHT THE 

TIME ON 



LESS 



DECIDED 

WORK 



TO 



SPEND 



MORE 1 



COMMITTEE 

REWARDING 
***** 

XOOOl 
***** 

THOUGHT! F43 — BILL!)tF45 — DECIDED! F4 — COMMITTEE! F— THE!))* 
F6 — SPEND! FI— TO! ItFll— TIME! F7— MORE! ) tF61— ON! F48— WORK 
F47— REWARDING! F7 — LESS! » 1 9 » 1 1 1 1 



***** 

X0070 

***** 



***!) 



o 

ERIC 



V 






F 



I 



current 


SENTENCE IS..*. 






i 
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THE 


COMMITTEE DECIDED 


NOT 


TO 


spend 


MORE 


MONEY 


AND 

TIME 


TO TABLE THE 

• 


BILL 

***** 

XOOOl 

***** 


FOR 


A 


LITTLE 


MORE 



DEC I DEO ( F4—C0MMI TTEEI F— THE( ) ) *F6 — SPEND! FI— TCU.F49— 
NOT I)*F 11— HONEY ( F7— MORE( )))— ANO( F54 — TABLE! FI— TO!) .F8 
— BILL( F — THE( ) ) #F59 — FOR! F60 — TIME( F7— MORE( F68 — LITTLE( 
F69-Aimi)})l 



***( ) 



##### 

X0070 

***** 



CURRENT SENTENCE IS*.*. 



BILL 



WILL 



HAKE THE TABLE NOT BUY .IT 

***** 

XOOOl 

***** 

MAKE! F2— WILLI )fF33~BlLLI)tF40— TABLE! F— THE I ) ) .F62— BUY! 
F49— NOT ( ) tF44— IT I ) ) ) 



***t) 


X0070 

***** 










CURRENT SENTENCE IS.... 

BILL AND YOU WILL 

COMMITTEE 


DO THE 

***** 

XOOOl 

***** 


HARD 


WORK 


FOR 


THE 



DO! F2 — WILLI) tF24 — AND! F9— BILL! ) — YOU! ) ) *F26 — WORM F28 — 
HARD! F— THE!)) »F30— FORI F32— COMMITTEE! F--THE! ) ))) ) 



***** 

X0070 

. ***** 

***! ) 





T . .p. I -pi ,< Ml III ^ ^ I [*WjA t "™ ; "J / jj. i^i ip . i m]\ *1 W^M. V 
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I 



OECIOEO 

BILL 



THE 

THOUGHT 



IT 



CURRENT SENTENCE IS#### a 

AFTER FURTHER SEARCH THE COMMITTEE 
TABLE WAS WORTH MORE MONEY THAN 
WAS WORTH • 

***** 

X0001 
***** 

DECIDED! F4— -COMMITTEE! F — THE! » t »F50— AFTER! F51“- -SEARCH! 
F1<1 — FURTHER (IK. F6-- TABLE! F--THEI I.F8— BILL! 1 1— WAS! F5— 
WORTH! F52— MONEY! F7 — MORE! F21-- THAN! F22~ -THOUGHT ( F45 — 
WAS I F5— -WORTH I II II I II *F3— I T 1 1 II 



***** 

X0070 

***** 



***( ) 



CURRENT 

THE 



THE 



SENTENCE 

SEARCH 

COMMITTEE 



IS. 



FOR A 
DECIDED 



WAS 

BUY 



SUCCESS 



AND 



IT 



i 



TABLE 
TO 
***** 

X0001 

***** 

ANDt F54~ WAS( F3 — SEARCH ( F--THE ( ) .F19—FOR ( F65— TA8LE( 
— A())tF32 — COMMITTEE ( F — THE ! ) ) ) ) — SUCCESS ( F27 — A ( ) ) ) 
DECIDED! F6 — BUY! FI — T0!)*F44 — IT!)))) 



F27 



***** 

X0070 

***** 



***( ) 



CURRENT SENTENCE IS.... 
YOU WILL 
LITTLE 



THAT 



BILL 



WILL 



WORK 



HARD 



FOR 



NOTICE 
MONEY 

***** 

X0001 

***** 

NOTICE! F2— WILL! I .F34--YOU! I .F36--THAT < F37--WORM F2--WILL 
),F41--BILL!)*F28--HARD(I.F30--FOR( F39“ MONEY! F7— LITTLE.) 

Ill I 



***** 

X0070 

***** 



***( ) 




19 



l 

X 



I PR- 12 

Page* 58 



CURRENT SENTENCE IS..** 

AFTER FURTHER THOUGHT 
SEARCH COMMITTEE WORK 



OEC IOED ( F4 
),F6~ MAKE! 
COMMIT 1 EE ( ) 



BILL DEC 1 DEO 

• < 

##### 

XOOOl 

***** 

-BILL ( ) *F50 — AFTER ( F51 
FI — TO!)*F40 — SEARCH! F 
))) 



TO MAKE THE 



-THOUGHT! F14— FURTHER! )) 
-THE ( ) * F56— WORK ( F72— 



***** 

X0070 

***** 

***( ) 



CURRENT SENTENCE IS.... 

TO BUY MUCH AND 



SPEND 



LITTL-E 



IS 



HARD 



TO 



DO 



***** 

XOOOl 

***** 

IS! F3— AND! F57— BUY! FI— TO! ) *F44— MUCH! ) )- 
LITTLE! ))) tF5 — HARD! F58 — DO! FI— —TO! Ill) 



-SPEND! FI 1 — ^ 



***** 

X0070 

***** 



***< ) 



CURRENT SENTENCE IS.... 



YOU 

MONEY 



CAN 

BUT 



SPEND 
MONEY 



LIFE AND 
LITTLE 



MAKE 

TIME 



MUCH 



A HARD 

WILL BUY 

***** 

XOOOl 
***** 

RUT! F46— AND! F54— SPEND! F33— CAN! I »F25— YOU! I tFll— LIFE! 
F28”HARD( F69”A( ) ) ("LITTLE! ) )-“MAKE( FAO--MONEY. F7-MUCH( 
) ) ) ,F9— MONEY! ) ) *F71— BUY! F2— WILL! ) *F44— TIME! ) > > 



***** 

X0070 

***** 



***( ) 
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CURRENT SENTENCE IS.... 

YOU CAN MAKE MONEY 

AND THOUGHT ANO DO 



YOU 

WORK 



SPEND 



MORE 



TIME 



IF 

HARD 

####» r 

XOOOl t 

***** 

IF C F29— MAKE! F35 — CAN! ) *F33 — YOU! ) tFAO — MONEY ( I ) * F 3 1 — SPEND 
! F25— YOU! )*F11 — TIME! F7““ MORE ( I *F13 — AND! F9— THOUGHT ())) ) 
—AND! F54—D0! F26 — WORK ( F28~ HAR Dllllll 



***** 

X0070 

***** 



***( ) 



CURRENT SENTENCE IS.... 



THE 

SPEND 



MORE 



MONEY 



YOU 



MAKE 



THE 



MORE 



MONEY 



YOU 



***** 

XOOOl 

***** 

MAKE ( F33--YOUI >*F40~ MONEY! F7— MORE! F70— THE C ) ) ) — MONEY < 
F7—MORE! F70— THE( m*F67— SPEND! F25--YOU!))) 



***** 

X0070 

***** 



***( ) 



CURRENT SENTENCE IS.... 
TIME IS MONEY 



SPEND 



WISELY 



IT 
***** 

XOOOl 

***** 

IS! F3~TIME<)~MONEY<)*F67~ SPEND! Fll — IT <) *F38~ WISELY! )) ) 



***** 

X0070 

***** 



*** ( ) 



o 

ERIC 
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CURRENT SENTENCE IS.... 

THE MORE YOU WORK 
MAKE • 



THE 

***** 

XOOOl 

***** 



MORE MONEY 



YOU 



WILL 



WORK( F41 — YOU( )*F7 — MORE( F70— THE ()) »F67— MAKE ( F2— WILLO 
P33--yOU( ) *F40— MONEY! F7— MORE( F70”“THE( ) )) ) ) 



***** 

X0070 

***** 



***( ) 



CURRENT SENTENCE IS.... 

IT IS HARO TO 

TIME 



MAKE 



MUCH 



MONEY 



IN 



LITTLE 



***** 

XOOOl 

***** 



I SI F3— I T t )*F5~ HARD! F58 — MAKE ( FI — TO( )*F40 MONTY ( F7— 
MUCHI F53--IN! F55-- TIME! F7 — LITTLE I F69~ A< ))))))) )) 



***( ) 



***** 

X0070 

***** 



CURRENT SENTENCE IS.... 

I F YOU DO MUCH 

LIFE 



WORK 



YOU 



WILL 



SPEND 



A 



H AR D 



***** 

XOOOl 

***** 

IFI F29 — DOI F24 — YOU! ) *F26— MUCH I ) ) ) 



***** 

X0002 

***** 

WORKI F67 — SPEND! F2— WILLI ) »F25~YOU< ) *F11--LIFE( )) .r *- 

HARDI F69— AID) 



***( ) 



***** 

X0070 

***** 
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] 



'1 



CURRENT SENTENCE IS**** 
YOU CAN MAKE 
SPEND IT 



MONEY 



WORK 



FOR 



YOU 



IF 



YOU 



WISELY 



***** 

XOOOl 
***r * 



IF( F29 — MAKE ( F35 — CAN!)*F33 — YOU!)*F40 — MONEY ( ) *F66 WOR<( 
P30 — FOR ( F32 — YOU( ) ) ) ) »F31 — SPEND! F25 — YOU()*Fll IT()»F38 
—WISELY!))) 



!' 



***** 

X0070 

***** 



***( ) 



CURRENT SENTENCE IS* • • • 
HAPPINESS IS MONEY 



AND 



THE 



TIME 



TO 



SPEND 



IT 



***** 

XOOOl 

***** 

AND! F54— IS! F3— HAPP INESS () —MONEY ()) *F9 
F13— SPEND! FI— TO! ) *F1 1 — I T < ) ) ) ) 



— TIME! F--THF ( ) * 



***** 

X0070 

***** 



*** ! ) 



CURRENT SENTENCE IS..** 

IT IS HARD TO 

SPEND IT 



TO 



MAKE 

WISELY 

***** 

XOOOl 
***** 



money 



AND 



IT 



IS 



HARD 



IS! F3— AND! F54 — IS ! F3 — IT« ) — IT! ) *F5 — HARD! F58— MAKE ! FI 
— TO! ) *F40— MONEY! ))))) *F5— HARD! F58 — SPEND! FI— TUOtFil — 

IT!) *F38 — WISELY!)))) 



***** 

X0070 

***** 



*** ! ) 




Mia 



■ > .-S u. ■- 



» 



I 
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CURRENT SENTENCE IS.... 



SUCCESS 

MORE 

MONEY 



IN THE SEARCH FOR 
REWARDING THAN SUCCESS 



HAPPINESS 
IN THE 



IS 

SEARCH 



MUCH 

FOR 



####* 

XOOOl 

***** 



IS( F3— SUCCESS! FIT — INC F15 — SEARCH ( F— THE ( ) .F19~ FOR ( F23 
—HAPPINESS!) ) ))) *F5— REWARDING! F7— MORE! F68—MUCH! ) *F21 — 
THAN! F22— SUCCESS! F17 — IN! F15— SEARCH! F— THE ! ) *F19— FOR ( 
F39— MONEY! )))))))) ) 



***** 

X0070 

***** 



***( ) 



CURRENT SENTENCE IS.... 



YOU 



CAN 



YOU 



DO 

SPEND 



MUCH 

TIME 



WORK 



IN 



LITTLE 



IME 



IF 



MORE 
WISELY 
***** 

XOOOl 

***** 

IF! F29 — DO! F35— CAN! ) *F24— YOU! ) tF26— MUCH! ) — WORK ( F7 — 
MORE! ) *F30— IN! F55— TIME! F7— LITTLE! ))))) tF31— SPEND! F2S— 
YOU! ) .Fll— TIME! ) .F38— WISELY! ) ) ) 



***** 

X0070 

***** 



***( ) 



CURRENT SENTENCE IS.... 
; MONEY WILL BUY 

HAPPINESS 



MUCH 



BUT 



IT 



WILL 



NOT 



BUY 



***** 

XOOOl 
***** 

BUT! FA6~ BUY! F2— WILL! ) .F42— MONEY! ) .F44— MUCH! f —I T ()) *F7 
—BUY! F49— NOT! ) *F2— WILL! ) * FA4— HAPP I NESS { ) ) ) 



***** 

X0070 

***** 



***( ) 
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CURRENT 


SENTENCE IS.... 






YOU 


WILL 00 MUCH 


IN LIFE 


IF YOU 


A 


LITTLE MORE 


TIME ANO 

**#«« 


THOUGHT • 






XOOOI 

##### 





I F ( F29— D0( F2~WILL( ) *F2A~YOUO *F26~MUCH( F53~ IN 
LIFE I ) »F55 — T I ME < F7— MORE! ) *F13~ AND! P9— THOUGHT () ) 
— SPEND! F2— WILLI) »F25—YOUO*F11— LITTLE! F69— A( ) ) 



SPEND 



F 18 — 

) ) ) ) » F3 1 
) ) 



###( ) 



##### 

X0070 

##### 
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APPENDIX 

I 

Materials used in the experiment 

I 

Sentence diagrams . 

The following pages contain the labeled dependency trees 
from which JIGSAW-1 was Initialized. The diagrams are meant to 
reflect the structure of the sentence; however, if the diagrams 
given differ from the reader's intuition in minor respects this 

i 

does not invalidate the experiment. 

Arrows are used to connect dependent words to their 
governors, with the arrow head near the governor. Labels appear to 
the right of their associated arrows; they take the f6rm of under- 
lined numbers. In the program, the labels are IPL symbols of the 
form FN where N is a one or two digit Integer and corresponds to 
the numbers on the diagrams. The Integer over the initial letter 
of each word designates the serial position of that word in the 
original sentence. 

labels. 

An attempt has been made to assign a "sensk” to each label. 
Naturally JIGSAW-1 is unaware of any such Interpretation; to the 
program labels are merely arbitrary symbols. The table is Included 
solely as an aid to the reader, and to provide an index to the 
occurrences of the labels. 

Syntax and semantics . 

The information derived from the diagrams and used to form 

the dictionary and syntax routines is summarized in a table. For 

# 

each word, the D3 list is composed of all the labels in the third 

i 

o 

ERIC 
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t 

column of the tftbloj list D4 is composed of ell ths lsbsls In 

* 

the fourth column which are preceded by an asterisk; list Q101 
is composed of all labels in the third column which are preceded 
by an asterisk; list Q100 is composed of all labels in the fourth 
column which are preceded by an asterisk* 1 1 



! 



t 



O 



— — ■fa. ----- IV. A» >■>■’•— 1^1 - ■> «■- 
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Sentence 2 



1 

BILL 



2 

THOUGHT 




DECIDED 




COMMITTEE 




SPBND 




48 



13 
WORK 



47 



12 

REWARDING 

0 

( 



11 

LESS 



ERIC 
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3 

Sentence 3 DECIDED 
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Sentence 6 



ERIC 



6 

DECIDED 




15 

THOUGHT 



MORE 





>--<• J* - *>T1 -» - r jsa»ryjvrtfi.^v !> 4 TV r\ 
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Sentence 9 





THOUGHT 

14 

2 

FURTHER 



7 

MAKE 




COMMITTEE 



7 




9 

TO 





' ‘■Si 
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11 




28 



5 

HARD 



9 

MUCH 



62 




16 

TIME 



15 
LITTLE 




Sentence 12 




4 

MONEY 



MORE 



ERIC 
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5 
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Sentenoe 15 




Sentence 16 






B 



IS 



11 
TIME 



10 
LITTLE 



69 



MONE” 



ERJC 
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3 

ERIC 



Sentence 21 



7 
IS 



1 

SUCCESS 




REWARDING 




9 
MORE 



3 

THE 




8 

MUCH 



HAPPINESS 




41 



13 

IN 



42 



13 
SEARCH 
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MONEY 



er|c 



J 
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] 



Label 

FO 

FI 

F2 

F3 

F4 

F5 

F6 

F7 

F8 



F9 

FIO 

Fll 

i 

| F12 

1 FI 3 

? 

? PI 4 



?15 



1 Pl6 

I F17 

I F18 



F19 




the labels used in the experiment 
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Sentences In which used 

0,1,2,3,3,4,5,5,6,6,7,7, 

9,16,19,21,21 

0,2,3,3,7,9,10,10,20,20, 

4,5,8,8,11,15,17,23,23, 

24,24 

1,6,6,7,7,10,14,14,16,19, 

20,20,21 

0 , 2 , 3 , 6 , 7, 9 

1,6,6,10,16,19,20,20,21 
0,2, 3,6, 7, 9 

2,2,3,3,6,8,11,11,12,13, 

13,15,16,16,17,21,22,22, 

24 

0,3 



5,5,12,12,19,19,24,24 

0 



2,3,10,11,12,13,14,17,18, 

19 , 20 , 22 . 



0 

19,24 

0,6,9 

1 , 21,21 

1 

21,21 

24 



1,7,21,21 



"Sense" of the label 



"the "-noun# Definite article. 



"to"-verb# Infinitive construction, 
"will "-verb. Auxiliary, future. 



noun phrase-copulative verb, 



noun phrase- "decided". Act of deciding, 
copulative verb-predicatte adjective. 
"decided"-object. Denote! selection. 



modifier-noun or adjective. Mod- 
ification delimits amount, as in 
"much more". 



"table"-"bill". Sense of setting 
aside for later decision. 



noun- "and". Conjunctive noun phrase, 
verb- "until". Temporal relation. 
"spend"-noun. Sense of purchasing. 



1 

"until "-object. Temporal relation. 



"spend"-noun. Sense of expending 
effort, time, or thought. 



noun-adjective. Sense of additional 
or more, as in "more time". 



"in"-noun. Sense of engaged in, as 
in "in search". 



/erb-verb. Subordinate clause. 
noun-"in". As in "success in". 



"in"-noun. Sense of during, as in 
"in life". 



/erb-preposition. Sense of compound 
/erb, as in "search of". 
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P20 


1 


"on"-noun. Indication of position. 


P21 


6,21 


"more "-"than". 

1 


P22 


6,21 


"than "-noun. Sense of comparing. 


F23 


2,21 


"for" -noun. Sense of a quest, as in 
"look for". 


P24 


5,17,22,24 


subject-verb ("do"). Subject may be 
compound, headed by conjunction. 


P25 


11,12,13,17,18,22,24 


pronoun- verb. Sense of actor-action 

i 


P26 


5,12,17,22,24 


"do"-noun. Sense of action-object. 


P27 


7,7 


"a"( "an")-noun. Indefinite article. 

1 


P28 


5,8,11,12,17 


adjective-noun.* Sense of difficult, 
as in "hard life". 


P29 


12,18,22,24,17 


"if"-Y in context "if X then Y". 


P30 


5,8,18,22 


noun-preposition. As in "work for". 


P31 


12,18,22,24,17 


"if "-X in context "if X then Y". 


F32 


1 

5,18 


"for" -noun. Sense of in behalf of. 


P33 


4,12,13,15,18 


sub j ec t - "make " „ 


P34 


8 


subject-"notice". Sense of taking 
note of. 


F35 


11,12,18,22 


"can"-verb. Auxiliary, indicating 
possibility. 


P36 


8 


verb-" that". Relative pronoun. 


P37 


8 


"that"-work. Relative pronoun. 


P38 


14,18,20,22 


verb-adverb. As in "spend wisely". 


P39 


8,21 


"for"-noun. Sense of to obtain, as 
in "for money". 


P40 


4,9,11,12,13,15,16,20 


"make "-ob j ec t . 


P4l 


8,15,18 


subject- "work". Sense of doing. 

1 


P42 


11,23,23 


subject-"buy". 


P43 


6 


subject-" thought". Sense of being 
under the impression that. 



F44 4,7,10,11,23,23 



"buy"-obJect. 
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F45 


2,6 

• 1 


verb-verb. Connecting clauses with 
an understood relative pronoun# 


P46 


11,23 


X- "but "in context "you can X, but". 


F47 


2 


adjective-mAm. As 1 in "rewarding 
work". 


F48 


2 


"on "-noun. Sense of engaged in. 

i 


F49 


3,4,23 


♦ 

"not "-verb. Auxiliary, negation. 


F50 


6 


verb- "after". Sense of following 
in time. ( 


F51 


6,9 


"after "-noun. Sense of following 
in time. 


F52 


6 


"worthy-object. Sense of valuation. 


F53 


24 


"much"- "in". . 


F54 


3, 3,7,7, 11* 11 >12, 12, 20, 20 


word- "and". Conjunction. 


F55 


16,22 


"in" -"time". 


F 56 


9 


"search"-object. Action-object. 


F57 


10,10 


verbal noun- "and". 


F58 


10 , 16 , 20,20 


"hard "-verb. Sense of difficult. 


F59 


3 


verb-"for". Temporal sense. 

i 


F 60 


3 


"for"-noun. Temporal sense. 


F6l 


2 


noun-"on". Sense of assigning to, 
as in "time on". 


F62 


4 


verb-verb. Disjunction of clauses. 


F 63 


15 


verb- "more". 


F64 


16 


verb- "in". Temporal relation. 


F 65 


7 


"for"-noun. As in "search for X". 


f66 


18 


verb-verb. As in (you can)make 
(money) work. 


F 67 


13,14,15 


1 

verb-verb. 


f68 


3,21,22,24 


adverb-adjective. Sense of delimit 
amount, as in "little more". 


F 69 


3,ll>l6,17,24 


"a"-adverb. As in "a little". 



F70 5,13,13,15 

F71 11,23 

F72 9 
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“the "-nominal adjective. As in 
"the lore the merrier", 

"tout"-Y in context “You can X/out Y". 

"committee M -"wojrk", 
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SYNTAX/SEMANTICS TABLE FOR CORPUS USED IN THE EXPERIMENT 



Word 



Symbol Labels word may be value of Labels word may be symbol for 
(and precede if ») (and precede If ») 



1 0 

A 


All 


, *27, *69 


AFTER 


A '43 


*50 


AND 


A3 


*3, 5,6, 11, 13, *24,31, *46 


BILL 


A 36 


*4,8,*9,*33,*4l,*43 


BUT 


A15 




BUY 


A1 


6, *46, *57,62,71 


CAN 


AlO 


*35 


COMMITTEE 


A32 


*4, 32, *72 


DECIDED 


A33 


45,54 


DO 


a8 


*29,31,54,58 


FOR 


A26 


19,30,59 


FURTHER 


A38 


*14 


HAPPINESS 


A27 


*3,23,44 


HARD 


A7 


5, *28 


IF 


A19 




IN 


ai8 


5,17,30,53,64 


IS 


a6 


*54 


IT 


A24 


*3, 11, *>42,44 


LESS 


A42 


*7 


LIFE 


A12 


11,18 


LITTLE 


A5 


*7, 11, *68 


MAKE 


A13 


6, *29, 54,58,67 


MONEY 




3, *9, 11, 39, *40, *41, *42, 52 


MORE 


A21 


*7, *63 



o 




*51 

*9, *5^ *57 
0 

46, *71 

1,2,42^*44,49 

0 

4, *6, 50 

1,2, 24, *26, 35 

*23, *32, *39, *60, *65 



0,*58,69 
*29, *31 
*15, *18, *55 
*3, *5, *67 



28 



69 

1 , 2, 33, 35, *4' ■ , '62, *64, *66 , * 6 ‘ 



7 

*21,68,70 




L« « <f 
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SYNTAX/SEMANTICS TABLE FOR CORPUS USED IN THE EXPERIMENT 



Word 


Symbol 


Labels word may be value of 
(and precede if *) 


Labels word may be symbol 
(and. precede if *) 


MUCH 


A2 


*7, 26, 44, *68 


*53 


NOT 


A34 


*49 




NOTICE 


A39 


*3,12 


0,2,14, *16,34, *36 


•OF 


a 46 


19 




ON 


A4l 


5,61 


*20, *48 


REWARDING 


A30 


5, *47 


7 


SEARCH 


A29 


*3,15,40,51 


0,l4, *19»*56 


SPEND 


A4 


6,13,31**54,57,58,67,29 


1,2, *11, *13,25, 35, *38,49 


SUCCESS 


A28 


*3,22 


*17,27 


TABLE 


A35 


*3,6,20,40,54,65 


0;1,*8,*10,27,*59 


THAN 


A31 


21 


*22 


THAT 


A47 


36 


*37 


THE 


A23 


*0,*70 




THOUGHT 


A20 


9,22,51 


14, 43, *45 


TIME 


A17 


*3, *9, 11/ 44,55,60 


0,7, *13, *6l 


TO 


a48 


*1 




UNTIL 


A37 


10 


*12 


WAS 


A45 


6, 45, *54 


*3, *5 


WERE 


A40 


16 


3, *5 


WILL 


ai6 


*2 




WISELY 


A25 


38 




1 WORK 


A22 


26,37,48,56,66 


2, 7, *28, *30,41, '.7,63**67 


WORTH 


A 44 


5 


*52 


YOU 


A9 


*3,9, *24, *25, 32, *33, *34, *4l 




i ERLC 

B. 

L, : 
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